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Abstract 

General aspects of the Fluctuation-Dissipation Relation (FDR), and Response The- 
ory are considered. After analyzing the conceptual and historical relevance of fluc- 
tuations in statistical mechanics, we illustrate the relation between the relaxation of 
spontaneous fluctuations, and the response to an external perturbation. These stud- 
ies date back to Einstein's work on Brownian Motion, were continued by Nyquist 
and Onsager and culminated in Kubo's linear response theory. 

The FDR has been originally developed in the framework of statistical mechanics 
of Hamiltonian systems, nevertheless a generalized FDR holds under rather general 
hypotheses, regardless of the Hamiltonian, or equilibrium nature of the system. In 
the last decade, this subject was revived by the works on Fluctuation Relations 
(FR) concerning far from equilibrium systems. The connection of these works with 
large deviation theory is analyzed. 

Some examples, beyond the standard applications of statistical mechanics, where 
fluctuations play a major role are discussed: fluids, granular media, nano-systems 
and biological systems. 
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1 Introduction 

1.1 Introductory remarks and plan of the paper 

Recent developments in non equilibrium statistical physics have convinced us 
that times are ripe for a review of the vast subject concerning the fluctuations 
of systems described by statistical mechanics. This issue is important even 
beyond the "traditional" applications of statistical mechanics, e.g. in a wide 
range of disciplines ranging from the study of small biological systems to tur- 
bulence, from climate studies to granular media etc. Moreover, the improved 
resolution in real experiments and the computational capability reached in 
numerical simulations has led to an increased ability to unveil the detailed 
nature of fluctuations, posing new questions and challenges to the theorists. 

One of the most important and general results concerning systems described 
by statistical mechanics is the existence of a relation between the spontaneous 
fluctuations and the response to external fields of physical observables. This 
result has applications both in equilibrium statistical mechanics, where it is 
used to relate the correlation functions to macroscopically measurable quan- 
tities such as specific heats, susceptibilities and compressibilities, and in non 
equilibrium systems, where it offers the possibility of studying the response to 
time dependent external fields, by analyzing time-dependent correlations. 

The idea of relating the amplitude of the dissipation to that of the fluctua- 
tions goes back to Einstein's work on Brownian motion. Later, Onsager put 
forward his regression hypothesis stating that the relaxation of a macroscopic 
nonequilibrium perturbation follows the same laws which govern the dynamics 
of fluctuations in equilibrium systems. This principle is the basis of the FDR 
theorem of Callen and Welton, and of Kubo's theory of time dependent corre- 
lation functions. This result represents a fundamental tool in non-equilibrium 
statistical mechanics since it allows one to predict the average response to ex- 
ternal perturbations, without applying any perturbation. In fact, via an equi- 
librium molecular dynamics simulation one can compute correlation functions 



4 



at equilibrium and then, using the Green-Kubo formula, obtain the transport 
coefficients of model liquids without resorting to approximation schemes. 

Although the FDR theory was originally applied to Hamiltonian systems near 
thermodynamic equilibrium, it has been realized that a generalized FDR holds 
for a vast class of systems with chaotic dynamics of special interest in the study 
of natural systems, such as geophysics and climate. 

A renewed interest toward the theory of fluctuations has been motivated by 
the study of nonequilibrium processes. In 1993 Evans, Cohen and Morriss 
considered the fluctuations of the entropy production rate in a shearing fluid, 
and proposed the so called Fluctuation Relation (FR). This represents a gen- 
eral result concerning systems arbitrarily far from equilibrium. Moreover it is 
consistent with the Green-Kubo and Onsager relations, when equilibrium is 
approached. Starting with the developements of the FR proposed by Evans 
and Searles and, in different conditions, by Gallavotti and Cohen, continuing 
with the Crooks and Jarzynski relations, and the recent works by Derrida and 
coworkers and Jona-Lasinio and coworkers on dynamical path probabilities, 
the last 10-15 years have produced a whole new theoretical framework which 
encompasses the previous linear response theory and goes beyond that, to in- 
clude far from equilibrium phenomena, such as turbulence and the dynamics 
of granular materials. 

In this paper, we only consider systems which are ergodic and have an invariant 
phase space distribution, which is reached in physically relevant time scales. 
Therefore, we do not discuss aging and glassy behaviours. For such interesting 
issues the reader is referred to recent reviews [?,?,?]. 

This review is organized as follows. In this section we give a brief historical 
overview on the origin of FDR, in particular of its relevance to the "proof" 
of the existence of atoms. In Section 2 we present the classical fundamen- 
tal contributions of Onsager and Kubo to the general theory of FDR. The 
third Section is devoted to a discussion of FDR in chaotic systems. It is 
shown that a generalized FDR holds under rather general conditions, even 
in non-Hamiltonian systems, and in non-equilibrium situations. In addition, 
we discuss the connection between this FDR and the foundations of statistical 
mechanics, and anomalous diffusion. Section 4 treats non-standard applica- 
tions of the FDR: fluid dynamics, climate, granular materials and biophysical 
systems. The different approaches to the FR are discussed in Section 5. In Sec- 
tion 6 we discuss the numerical and experimental investigations of the FR in 
stochastic systems, granular gases and conducting systems. Section 7 concerns 
the seminal work of Onsager and Machlup, and the recent results in extended 
non-equilibrium systems, in terms of large deviations theory. Four Appendices 
conclude the paper. 
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1.2 Historical overview 



The study of the fluctuations, and of their relation with the response to exter- 
nal perturbations, has an important conceptual and historical relevance, apart 
from its technical interest which is now universally recognized. Therefore we 
give a brief overview of Statistical Mechanics at the beginning of the 20-th 
century. 

1.2.1 Fluctuation Phenomena and Atoms 

In spite of the great successes of the atomistic hypothesis in chemistry and 
kinetic theory, towards the end of the 19-th century, some influential scien- 
tists such as Ostwald and Mach still claimed that it was possible to avoid 
the atomistic perspective in the descriptions of nature. Indeed, there was no 
unquestionable evidence of the existence of atoms at that time. The atomic 
theory plays a role in physics similar to that of certain auxiliary concepts in 
mathematics; it is a mathematical model for facilitating the mental reproduc- 
tion of facts [?], was stated by Mach. 

Even Boltzmann and Gibbs, who already knew the expression for the mean 
square energy fluctuation, correctly thought that fluctuations would be too 
small to be observed in macroscopic systems: In the molecular theory we as- 
sume that the laws of the phenomena found in nature do not essentially deviate 
from the limits that they would approach in the case of an infinite number of 
infinitely small molecules [?]. 

... [the fluctuations] would be in general vanishing quantities, since such expe- 
rience would not be wide enough to embrace the more considerable divergences 
from the mean values [?]. 

One of the reasons of Einstein's and Smoluchowski's interest for statistical 
mechanics was to find conclusive evidence for the atomic hypothesis. At vari- 
ance with the ideas of Boltzmann and Gibbs, their efforts attributed a central 
role to the fluctuations. The equation we finally obtained (eq. 1.11) would 
yield an exact determination of the universal constant (i.e. the Avogadro 
number), if it were possible to determine the average of the square of the energy 
fluctuation of the system; this is however not possible according our present 
knowledge [?]. 

1.2.2 Brownian motion: a macroscopic window on the microscopic world 

Einstein's hope came true in the understanding of a "strange" phenomenon: 
the Brownian motion (BM). In 1827 the Scottish botanist Robert Brown no- 
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ticed that pollen grains suspended in water jiggled about under the lens of the 
microscope, following a zigzag path. Initially, he believed that such an activity 
was peculiar to the male sexual cells of plants; further study revealed that the 
same motion could be observed even with chips of glass or granite or particles 
of smoke. For some decades such a phenomenon was considered as a sort of 
curiosity, although the BM attracted the interest of important scientists, such 
as Poincare [?]. 

The breakthrough in the understanding of the BM is due to the indepen- 
dent works by Einstein [?,?] and Smoluchowski [?] at the beginning of the 
20th century. A few years later, Langevin proposed an approach in terms of a 
stochastic differential equation, which takes into account the effect of molec- 
ular collisions by means of an average force, given by the fluid friction, and of 
a random fluctuating term [?]. 

The experimental works by Perrin and Svendborg on the BM can be considered 
as the first "proof" of the existence of atoms, while Langevin's equation, which 
has been the first example of stochastic differential equation, inspired the 
mathematical theory of continuous time stochastic processes. 

The basic physical assumptions in both Einstein's and Langevin's approaches 
are: 

a) Stokes' law for the frictional force exerted on a body moving in a liquid; 

b) the equipartition of kinetic energy among the degrees of freedom of the 
system, i.e. between the particles of the fluid and the grain performing BM. 

A colloidal particle suspended in a liquid at temperature T is thus assimi- 
lated to a particle of the liquid, so that it possesses an average kinetic energy 
RT/(2Na), in each spatial direction, where R is the perfect gas constant and 
N A is the Avogadro number. Accordingly, one obtains: 



According to Stokes' law, a spherical particle of radius a, moving in a liquid 
with speed V in the x direction, experiences a viscous drag force: 



where r] is the viscosity. This law holds if a is much larger than the average 
distance between the liquid molecules, in which case Stokes' force (fs) repre- 
sents the average macroscopic effect of the irregular impacts of the molecules 
of the fluid. 





fs = —aV = —Q-nrjaV , 
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Therefore, isolating the average force, the dynamical equation of the particle 
in the x direction can be written as 



dV 

m— = f s + f R (t) = -aV + f R (t) (1.2) 

where fait) is a random fluctuating force mimicking the effects of the impact 
of the molecules on the particle. Of course (fait)) = 0, and its characteristic 
time, being determined by the collisions of the molecules of the liquid with 
the colloidal particle, is much smaller than r = m/a. One can then assume 
that fa is a Gaussian stochastic process with (f nit) f nit')) = c5(t — t'), where 
c can be determined by the energy equipartition. Elementary computations 
give [?] 

«*« -*<°>] 2 > = ^ \* - ~. (' - e ^')l ■ <u» 



For a grain of size 0(1//), in a common liquid (such as water) at room tem- 
perature, the characteristic time r = m/a = m/6irr]a is 0(lCT 7 s). For t ^> r, 
we get 

(m - xm ^ t =JL-t. (1 .4) 

This leads to the celebrated Einstein relation for the diffusion coefficient D, 
in terms of macroscopic variables and of the Avogadro number: 

d = i,m m^m = . (1 . 5) 

t^oo 2t 6N A 7ir]a v 1 

Let us stress that (1.5) allows the determination of the Avogadro number (a 
microscopic quantity) from experimentally accessible macroscopic quantities, 
thus providing a non ambiguous link between the microscopic and macroscopic 
levels of description, in physics. 

The theoretical work by Einstein and the experiments by Perrin gave a clear 
and conclusive evidence of the relationship between the diffusion coefficient 
(which is measurable at the macroscopic level) and the Avogadro number 
(which is related to the microscopic description) [?]. Such a result could be 
considered as a "proof" of the existence of atoms: after that, even two cham- 
pions of the energetic point of view, like Helm and Ostwald, accepted atomism 
as a physical fact and not as a mere useful hypothesis. In a lecture in Paris, in 
1911, Arrhenius, summarizing the works of Einstein and Perrin, declared after 
this, it does not seem possible to doubt that the molecular theory entertained 
by the philosophers of antiquity, Leucippus and Democritos, has attained the 
truth at least in essentials [?]. 

Although Langevin's approach, like Einstein's, is, from a mathematical point 
of view, rather simple, there is a very subtle conceptual point at the basis of 
his theory of the Brownian motion. The ingenious idea is the assumption of 
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the validity of Stokes law (which has a macroscopic nature), together with 
the assumption that the Brownian particle is in statistical equilibrium with 
the molecules in the liquid. In other words, in spite of the fact that the mass 
of the colloidal particle is exceedingly larger than the mass of the molecules, 
energy equipartition is assumed to hold. 



1.3 Fluctuations in equilibrium statistical mechanics 

Equilibrium statistical mechanics predicts both the average value of the ther- 
modynamic observables and the size of their fluctuations about their equilib- 
rium values. In this section, we briefly report the salient features of the theory 
of fluctuations of extensive thermodynamic variables. 

Let us consider a large isolated system in thermodynamic equilibrium, and 
single out a small region representing the subsystem of interest (here named 
S), while the rest of the system constitutes a reservoir (R). Suppose that, due 
to the coupling with R, the extensive variable X of the system S can fluctuate 
about its equilibrium value, while the remaining extensive variables are held 
fixed. The probability of observing a fluctuation of size smaller than a value 
X Q is given by the canonical distribution function: 

P(X < X ) = e-^ h) [ X ° e~ hX dN(X) (1.6) 

J — oo 

where h is the intensive thermodynamic field conjugated to X, N(X) is the 
cumulative number of microstates with X < Xq, and the integral is to be inter- 
preted in the Riemann-Stieltjes sense if the spectrum has also a discrete part. 
The function ip(h), which normalizes the distribution function, is determined 
by the condition 

e^ h) = / e- hX alN(X) (1.7) 

J — oo 

and represents a thermodynamic potential. The function ip(h) is a Legendre 
transform of the entropy, or generalized Massieu function [?]. Note that, even 
if this argument is formal and therefore of general validity, when X is an 
extensive observable of a macroscopic system (i.e. in the thermodynamic limit) 
the function ip(h), or better its Legendre transform, can be seen in terms of 
large deviations theory, see Appendix B. 

If we consider the characteristic function: 

/oo 

e- {h " a)x dN(X) = e ^-«) e -m ( Lg ) 
-oo 

and expand ip{h — a) with respect to a, we obtain the cumulants, (X n ) c , of 
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the distribution 



n=l a - n=l n - a,L 

As an important example, we consider the energy fluctuations in a system S, 
at constant temperature. In this case X = E, h = f3~ x and tp(h) = —/3A(/3), 
where A is the Helmholtz free energy. By employing eq. (1.9) and using stan- 
dard thermodynamic relations, we obtain the following results: 



(E) e =(E!) = ~(PA(P)) = U (1.10) 

{ E^^)- { E)^^^^-f rM (1.11) 

(E%=(E 3 ) - 3(E) (E 2 ) + 2(E) 3 = (1.12) 

= klT*[2C v + T^}. (1.13) 

Formulae (1.10)-(1.13) are a manifestation of the relation between the fluctua- 
tions of the quantity X and the variations of the thermodynamic potential ip, 
with respect to the conjugate field h. The generalization to several extensive 
variables Xi, X 2 .., X r is straightforward and involves the generalized potential 
defined by 0(/ii, h 2 , .., h r ) 



e </>(hi,ha,..,h r ) 



= J .. J dX l ..dX r e {hlXl+ - +hrXr) dN(X l ,..,X r ) (1.14) 



(exp^ajXj) = e -^ hl ' h2 '-' h ^ J ..J dXL.dXrexp (fl( a j - h j) x ^j dN(X u .,X r ) 



(1.15) 



(X m ) c = -^-^(h u ..,h r ) (1.16) 
(X m X n ) c = — — iP(h u .., M . (1.17) 



Let us, now, consider the problem of relating the properties of a system whose 
Hamiltonian is T~t(P, Q) = Hq(P, Q) + XA(P, Q) to those of a similar system 
characterized by Ho(P,Q) only, where P = (pi, pjv), Q = (qi, Qjv)- If 
the perturbation induced by XA(P,Q) is small, the canonical distribution of 
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the system with A 7^ is to linear order given by: 

f(P o) = ex P(~^) „ exp(-PH ) 1-A/M(P,Q) 
f[ M) JdPdQexp(-pH) JdPdQexp(-(3H ) 1 - \(3{A(P, Q)) 

(1.18) 

or 

/(P, Q) = / (P, Q) (l - X(3 [A(P, Q) - (A(P, Q)) ] ) (1.19) 

where () stands for the average relative to the system with A = 0. The 
corresponding average change of a generic observable B(P,Q), induced by 
the perturbation, is to the same order: 

(AB} ^ J dPdQS(P,Q)(/(P,Q)-/ (P,Q)) 

~-A0 / dPdQS(P,Q)(A(P,Q)-(A(P,Q)> ))/o(P,Q)) 

= -Xp((BA)o-(B) (A) ) . (1.20) 

The last formula shows that the change of the observable B is related to the 
equilibrium pair correlation of B with the perturbation A. With the choice 
B(P, Q) = A(P, Q) = n we obtain: 

^ = fcj^lr = -((K)o - (n„)l)= -k B rc v (1.21) 

hence we connect the heat capacity, i.e. the response to an energy perturbation, 
to the energy fluctuations. 

Another relevant instance of the equilibrium fluctuation-response theorem is 
the relation between the correlation function T(r, r') (defined below) and the 
isothermal susceptibility x^(r, r'). In this case one considers the Hamiltonian 
to be a functional of the magnetization density m{r): 

H(m(r)) = n (m(r)) - J drh(r)m(r) (1.22) 

By using formula (1.20) with B = m(r) and \A = J dr'h(r')m(r') we find: 

XT (r, r') = (3[(m(r)m(r')) - (m(r)) (m(r')) } = /3F(r, r') . (1.23) 



1.4 Fluctuations in non- equilibrium statistical mechanics: the Einstein rela- 
tion between diffusion and mobility 



We already discussed the BM and its historical relevance for the atomic hy- 
pothesis and the development of the modern theory of stochastic processes. 
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In addition, in the celebrated paper of Einstein one can find the first exam- 
ple of FDR. Let us write the Langevin equation for the colloidal particle in 

"modern" terms 

dV l2^k B T 

dT = -^ + V^r" (L24) 

where 7 = a/m and r\ is a white noise, i.e. a Gaussian stochastic process with 
< r](t) >= and < r](t)r}(t') >= S(t - t'). The time correlation of V is 

C vv (t) =< V(t)V(0) >=< V 2 > , 

an easy computation gives 

roo 

D = / C vv (t)dt . 
Jo 

Consider now a small perturbing force f(t) = FQ(t), where 0(t) is the Heav- 
iside step function. The average response of the velocity after a long time (i.e. 
the drift) to such a perturbation is given by: 

< 5V >= - . (1.25) 

7 

Defining the mobility /i as: 

< 5V >= fiF 

one easily obtains the celebrated Einstein relation 

D 



// 



knT 



which gives a link between the diffusion coefficient (a property of the unper- 
turbed system) and the mobility, which measures the system's reaction to a 
small perturbation. This constitutes the first example of FDR. 



2 The classical linear response theory 

2. 1 Hamiltonian formulation of the FDR 



In this section we recall the derivation of Kubo's formula, which holds in the 
case of equilibrium dynamics [?]. Let us consider a system described by the 
Hamiltonian H(P,Q,t) = W (P,Q) - .F(t)A(P,Q), where W (P,Q) is the 
time-independent part. The evolution is governed by the Hamilton equations: 
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ggj = _|_ F{t\— = dn ° 

dt i)<ij i)<ij dq- 



+ jr(t)^ = -^-r(t)K?. (2.2) 



where we have introduced the "generalized forces" 



V'W *?=-g- (23) 



The associated T-phase space probability distribution evolves according to the 
Liouville equation: 

^/(P, Q, t) + *[£ + £ ext (t)]f(P, Q,t) = (2.4) 

where £ an d £ e: rt are the Liouville operators relative to the unperturbed 
Hamiltonian and to its perturbation respectively. These can be expressed by 
means of Poisson brackets as: 

icuof - -mu, a} = e (g A - g A) , . ( 2 . 6 ) 

We assume that the system is in thermal equilibrium at t — to, when Ti = 
Ho, and its statistical properties are described by the canonical equilibrium 
distribution, /(P, Q,t ) = f eq (P,Q), satisfying the equation iCof eq (P,Q,) = 
0. Switching on the perturbation, we obtain an approximate solution of (2.4), 
in the form: 

/(P, Q, t) = f eq (P, Q) - % f dt'e-^ Co C ext (t')f eq (P, Q) + . . . (2.7) 

J to 

which is valid to first order in iC ext (t). Using eq. (2.7), we can compute, to 
linear order in T{t), the ensemble average of an arbitrary function B(P, Q) 
of the phase space variables (P, Q), at time t, as follows: 

(B(t)) = J dPdQB(P, Q)/(P, Q, t) (2.8) 

so that its change with respect to the equilibrium value is: 

(AB(t)) = (B(t)) - {Bit = to)) = 

- i J dPdQB(P, Q) jf* dt'e- l ^ t,)Co C ext {t')f eq {P, Q) . (2.9) 
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Substituting, we find 

rt 
't 



(AB(t)) = J dPdQ5(P, Q) f dt'e-^ c ^(t f ){f eq , A}. (2.10) 



Using (2.6) and the fact that f eq (P, Q) depends on (P, Q) only through TCq, 
we write: 



(2.H) 

Since ^-JegiHoiP, Q)) = -Pf eg (H (P, Q)) and {H ,A} = -f we can write 



{AB(t))=pJ t dt'T{t') J dPdQB(PM)e- Ht - t,)Ca j t A(P,Q)t=ofe q (P,Q) ■ 

' ' (2-12) 
Finally, using the unitarity of the Liouvillian operator, we find: 



(AB(t)) =(3jjt'F{t') J dPdQ-A(P,Q)t=t fe q (P,Q)e l{t - t,)c "B(P,Q)- 

(2-13) 

If we introduce the response function, R(t), through the relation 



(AB(t)) = f dt'R(t - t')F(t'), (2.14) 

we may write 

R(t)=pJ dPdQj t A(P,Q)t=ofe q (P,Qy (t ~ t,)c °B(P,Q) = (3(A(t )B(t)) 

(2.15) 

which can also be rewritten as 

R(t) = -P(A(t )B(t)) (2.16) 

For later comparison, we can express the response function in a different guise, 
by defining the dissipative flux J(P, Q) 

J(P, Q)/ e(? (P, Q) = -{Wo, A} f eq {P, Q) = - £ (j^-K] + ^K^j f eq (P, Q) 
^{K]F^-Kf£jf eq (P,Q) (2.17) 

where we have introduced the force acting on the j-th particle, due to the 
Hamiltonian 7Y , as = — Using (2.17) we may write: 

R(t) = -pJ dPdQJ(P,Q)fe q (P,Q)e l(t - t,)c "B(P,Q) = -{3{J(t )B(t)) . 

(2.18) 
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2.2 Green-Kubo relations 



2.2.1 Diffusion 

In order to probe the diffusive properties of a system of particles, we apply 
a spatially uniform force h along an arbitrary direction, say the x-direction, 
and consider how the induced change of the average velocity depends on the 
external field. Due to the mutual interactions among the particles, this average 
velocity reaches a stationary value, because the drift current caused by the field 
is balanced by the diffusion current. 

In order to achieve such a situation, we add the following perturbation to the 
Hamiltonian: 

A(P,Q) = -h y £<$ (2.19) 

j 

so that the dissipative flux, introduced above, turns out to be: 

J(P,Q) = --E# (2.20) 

m j J 

We, now, compute the change of the average velocity along the x-direction, 
i.e. we set B(P, Q) = U X (P,Q) = ^EjPj- By applying formula (2.18) we 
have 

(AU x (t)) = -p jT di!T(i!) J dPdQJ(P,Q)e- t{t - t,)Co U x (P,Q)fe q (P,Q) 

(2.21) 

or 



(Au x (t))=(3— 2 fdt'Hf) I dPddY,pK l{t ' t,)Co T,plU^M) 

m Jto 3 k 

= P± fdt'Ht')Y,{p X oW k {t-t')) (2.22) 
m 2 Jt jk q 

We, now, set J-{t') = 1 for t' > 0, to — and take into account the fact 
that the momenta of different particles are not correlated in the equilibrium 
system: 

(AU x (t))=P—r t dt>Y,(p-(to)p-(t-t>)) . (2.23) 
m z Jo j x J J 1 e i 

At this stage, we connect the self-correlation function to the mobility, /i, 
through the relation (AU x (t)) = fih, to conclude that 

»=^J~ dt '^(mm) eq - (2-24) 
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Finally we obtain the diffusion constant from the Einstein relation D = fx/ (3. 



2.2.2 Shear flow 

Let us now discuss how to calculate the coefficient of the shear viscosity. 
Assume the following form of the perturbation operator: 

^( p ,Q) = ?EteM + ( ?M) ( 2 - 25 ) 

Z 3 

where 7 is the shear rate. The Hamiltonian with the above perturbation gen- 
erates the following equations of motion: 

at m J at m J 

§f - '7 - ^ = F 7-ypj ^ 

which are known as unthermostatted SLLOD equations describing a sheared 
fluid [?]. 

In this case the dissipative flux is: 

'(p> q) = 1 e i^m + + ?W) ( 2 - 2 8) 

and turns out to be proportional to the xy component of the pressure tensor 

P** = ± E (^PM + + VJ F J) (2-29) 

via the relation J(P, Q) = >yVP xy , where V is the volume of the system. By 
following steps similar to those leading to (2.24) we obtain 



(AP x »(t)) = -P J*dt'J dPdQJ(PM)e~ l(t - t,)Ci> P xy (P,Q)fe q (P,Q) 

= -\3iV f dt' (P xy (0)P xy (t')) eq . (2.30) 

J 

where again we have used (2.18) and J-{t') — 1 for t' > 0. 
Finally using the defintion of the shear viscosity 77 

(AP xy (t)) 

7] = - lim ^ ^ 2.31 



we obtain: 



POO 

V = PV dt'(P xy (0)P xy (t')) eq . (2.32) 

w 
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Eqs. (2.24) and (2.32) are just two examples of more general relations known as 
Green-Kubo relations, connecting the transport coefficients to the equilibrium 
two-time correlations of a system. 

A similar method is employed in order to derive relations for the thermal 
conductivity, A, and the bulk viscosity coefficient, k. The first of these relations 
reads: 



A = 



3Vk B T 2 
where 



/ dt'(S(0).S(t')) eq , (2.33) 

J 



S = E < «, >) | + i E E «* ■ F« + t/(q«)) I (2-34) 

where < > is the enthalpy per particle, U(qij) is the pair potential and 
Qij = — Qj- For details see [?]. 

Similarly, the bulk viscosity reads: 

K = mjrr , *X('r-wj"m) tt , (2.35) 

where a and b run over the spatial components, 

J ab = £ — + (2.36) 

and 



Linear Response for stochastic dynamics 



2.3.1 Langevin Dynamics 

Previously we discussed only Hamiltonian systems perturbed by a weak time- 
dependent external force. In the present section, we derive in a different fashion 
the FDR in systems subject to dissipative forces and random forces. Let us 
consider the following stochastic differential equation for the scalar variable 
A(t) 



where if L4(t)] is a function of A(t) and r\ is a white noise. 
We define the two-time correlation function as: 

C(t,t') = (A(t)A(t')) (2.39) 
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and assume without loss of generality t > t'. In order to calculate the response 
of the system to a time dependent external perturbation, we consider the 
following perturbation 

H h [A(t)]=H[A(t)]-h(t)A(t) (2.40) 

The variation of the quantity A(t), induced by the presence of h(t), is measured 
by the two-time response function, R(t,t'), defined as 

R ^ t] -^m (2 - 41) 

The Fluctuation Dissipation theorem relates the two-time correlation function 
with the response function. Let us compute the following derivative of C(t, t'): 



dC(t, f) 



dH[A(t)] 



A(t') ) (2.42) 



dt 

and subtract the derivative with respect to the argument t'\ 
dC(t,t>) dC(t,t') ^ dH[A(t)] ^ dH[A{t')] AU ^ lA(A ,,^ 

(2.43) 

where we dropped a noise term because of causality. We use now the property, 
which is proved by Onsager's argument (cf. [?], pages 49-50): 

(A(t)B(t + r)> = (A(t)B(t - t)) = (A(t + r)B(t)) (2.44) 

the first equality derives from time reversal, the last equality follows from 
the invariance of the equilibrium state under a time translation t — > t + r. 
Therefore, the first two terms in the r.h.s. of eq. (2.43) cancel each other. 
Finally, the last term can be evaluated by means of Novikov's theorem [?] 
which states that if i] is a Gaussian process and g is a function of A(t) then 

(2.45) 

Setting g(A(i)) = A(t) we obtain, using eq.(2.41) and the property {rj(t')r](t")) = 
6(1' -I")- 

(A(t)r](t')) = J dfRiiXmOvit')) = 2 7 Tit>(M') (2.46) 

and we find: 

^m.^Mi^ 2lTR(tX) ( , 47) 

At equilibrium, the two-time average depends only on the time difference, 
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hence, setting t' = t + s, we must have: 

dC(t,t + s) 



dt 



(2.48) 



or 



so that we have 



j t {A{t)A{t + 8 )) = -§;(Mt)A(t + s)) (2.49) 
dC(t,t>) dC(t,t') 

—dT~ = — W~ ( 2 - 5 °) 

dC{t £-=TTR(t,t). (2.51) 



dt 

We conclude that the response function has the form: 



R(t,t>) = ±9(t-t>)^±. (2.52) 



In order to connect this result with the static susceptibility, we switch on a 
constant perturbation e at time t — 0, and compute the change induced on 
the variable A, which is given, using relation (2.41), by the formula 

(A(t)) - (A(0)) = e f dt'R(t,t') = e\[C(t,t)-C(tM . (2.53) 
Jo 7-/ 

After defining the integrated response x by the formula: 

x(t,0) = ±[C(t,t)-C(tM (2-54) 
we can verify that its t — > oo limit coincides with the static response function 

Xst = ^[(A 2 ) - (A) 2 ] . (2.55) 

Here we have used the fact that the values of A at time t and at time become 
uncorrelated as t — > oo and that the average factorizes. 



2.3.2 Linear Response in Fokker-Planck equation 

The probability distribution function of the process described by a stochastic 
differential equation evolves according to a Fokker-Planck equation. Within 
the Fokker-Planck formalism, we can generalize the method of section 2.1 to 
systems subjected to an average drift and a fluctuating term. 

In such a case, the distribution /(x, t) evolves according to: 

-§/(x, t) = (C° FP + C%(t)) /(x, t) (2.56) 
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where C FP represents the Fokker-Planck operator of the unperturbed system, 
defined by 

C° FP f(x,t) = -J2 d J [^ (1) (x)/(x,t)] + £0A^?(*)/CM) (2.57) 

3 jk 

where the functions D^p and are related to the underlying Ito stochastic 
differential equations by 

^ = D?\x) +ZM S k^)m(t), (2.58) 

and 



£>^(x) = -M,-,(x)M I i(x) (2.59) 
where the white noise, r] k , is a Gaussian process with 



( Vk (t)) = 0, (Vj(t)vk(t')) = 5 ]k 5{t - t') . (2.60) 

We probe the response of the system, by adding an infinitesimal time-dependent 
perturbation of the form 

8Df\x,t) =J r (t)K j (x) . (2.61) 

Such a perturbation induces the following change in the Fokker-Planck oper- 
ator: 

CFp(t)f(*,t) = -^(OE^W/M) . (2.62) 

j 

We first determine the perturbed distribution, assuming that the system was 
stationary in the infinite past, i.e.: /(x, — oo) = / s t(x) and 

C FP f st (x) = . (2.63) 

An approximate solution of the perturbed problem 

p^,t) = [C FP + Cr P (t)]f^,t) (2-64) 

to first order in the perturbation C e FP can be represented as: /(x, t) ~ / s *(x) + 
A/(x, t), where Af is formally given by: 

A/(x,f)=r dt'e( t -* )c rr£%(lf)f 8t (x) . (2.65) 

J — oo 

With this approximation, the deviation of the noise average of a physical 
quantity -B(x), due to the perturbation (2.61), can be written as: 

(AB(t)) = (B(x,t)) - {B(x,t= -oo)) = J d N xB(x)Af(x,t) (2.66) 
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or, substituting eq. (2.65), 

(AB(t)) = f dt 1 f d N xB^e^-^ C%(t')f s \-x) (2.67) 

J —CO J 

compactly written as 

AB(t) = f dt'R(t - t')F(t') (2.68) 

J — oo 

where the response function R(t — £'), for t > reads: 

R(t) = -f d N xB^)e c °^ t ^d j (K j ^)r^)) (2.69) 
J j 

and R(t) = for t < 0, where (2.62) has been used. 

In order to relate the response function to the correlation in the unperturbed 
case, between two operators -B(x, t) and B(x.',t'), defined as: 

(B(t)B(t')) = J J d N xd N x'B(x)B(x')W 2 (x,t;x',t') (2.70) 

where PF 2 (x, t; x', t') is the joint probability distribution for the unperturbed 
case, we use the result: 

W 2 (x, t; x', t') = P(x, t, x', t')r'(x') = e £ °^ ( '-'' ) 5(x - x')r'(x') (2.71) 

where P(x, t, x', t') is the transition probability from configuration x' to x. 
Substituting such an expression in (2.70) we obtain 

(B(t)B(t')) = j d N x[6(t - t')5(x)e £ ^ (< - < ' ) fi(x) 

+ 9(t' - t)fi(x)e- £< ^ ( *-*' ) fi(x)] / s< (x) . (2.72) 

Hence, provided we make the identification 

B(t') = (3^1 = --L_ S9i(^(x)/-(x)) , (2.73) 



we can rewrite the response function as: 



(2.74) 



so that the analogy with the Hamiltonian formulation of the FDR is complete. 
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2.3.3 Kramers equation 



As an important special case, we consider the motion of a colloidal particle in 
an external field. To obtain a more useful expression and make contact with 
the FDR in Hamiltonian systems, we assume the Fokker-Planck equation to 
be of the form of a Kramers equation. Such stochastic dynamics can be con- 
sidered as a Hamiltonian dynamical system, in which the momentum equation 
is augmented by a friction and a noise term. Denoting x = (pj, qj), we have 



d Pj _ &H _ ^ + + j 2imkBTrij (2>76) 



j 



dt dq 

The associated linear evolution operators are 



and 



„ „ lm a a a« a \ / a a* \ 
£ - = -?l%a^-%-a^j + ^l^-' S a^j (277) 

£-(«) = -,,(«) 2 (aJ^+AJ^) ■ (2-78) 

When 'F(t) = the system has an equilibrium distribution / st (P,Q) = 
A / 'exp(— PHo), so that we may explicitly compute the expression: 



E *i(P> Q W(p, Q) = - + ^f^)/"( p > Q) 

= /5(^-Kj^)r t (P,Q) (2.79) 

= J(P,Q)/ rt (P,Q) (2.80) 

where the dissipative flux J(P, Q) is identical to the one in Eq. (2.17). 

By comparing eq. (2.80) and (2.69) one sees that, for t > 0, R(t) can be 
expressed as the two-time correlation: 

R(t) = ~PJ d N xB(P, Q)e £ W(P, Q)f st (P, Q) (2.81) 

which is similar to eq. (2.18), provided C° FP is replaced by —iC°. 
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2.3.4 Smoluchowski equation 



The Smoluchowski equation can be considered the Fokker-Planck (FP) equa- 
tion which arises in the overdamped limit, 7 — > 00 , of Langevin's equation 
(2.76): 

with T = 1/7717. The associated FP equation reads: 

^/({<z}, = (4 + £f (0) /({?}, t) (2.83) 

where £5 = T Ej dj{dj + {3djH ) and /^(t) = -FF(t) Ej In this case 

we find that the current is determined by the following condition: 

= /5K,F,r({g}) = J({g})r'({g}) (2.84) 

with f st ({q}) = Nexp{-[3H c onfig {{q})). We conclude that in this case the 
response function is: 

R(t) = -pJ d N qB({q})e C sKj({q})r\{q}) . (2.85) 

2.4 Johnson-Nyquist spectrum and Onsager regression hypothesis 

Even before Onsager's and Kubo's great synthesis, important results had been 
obtained in some specific cases or under special conditions. Such contributions 
played a significant role in the developement of statistical physics. In the 
following we illustrate in detail some of them. 



2.4-1 Frequency response and Johnson-Nyquist spectrum 

Equations (2.15)-(2.16), relating the response to a given perturbation and a 
suitable equilibrium correlation, is often useful in its frequency representation. 
If the external perturbation is periodic in time, 

F{t) =Re[K e iwt ], (2.86) 

because of linearity, the response reads 

(AB(£))=Re[xHK e iwt ], (2.87) 
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where is the admittance defined as the Fourier transform of the response 
function R(t): 

/OO poo 
R(t) e~ iuJt dt = [3 (A(t )B(t)) e~ luJt dt . (2.88) 



As an interesting example, we discuss the generalized Langevin equation, with 
a retarded frictional force ^(t): 



du(t) 
dt 



/■* 11 
= - 7(t-t')u(t')dt' + —r](t) + —F(t), t>t (2.89) 
Jt m m 



where the external force ^(t) is also included in this equation. The usual linear 
Langevin equation is the limiting case with ^(t) = 7#(t). It is immediate to see 
that the response of u(t) to a periodic perturbation of the form (2.86) reads 

(u(t)) = Re[ X (uj)K e i ^}, (2.90) 

where the admittance is given by 

XH = - ■ v (2.91) 

m too + 7(w) 

with 7(0;) the Fourier transform of 7(t). In other words, for a periodic pertur- 
bation, the admittance is analogous to the mobility. At equilibrium, T = 0, 
the self-correlation of u(t) can be calculated, and its Fourier transform reads 

/ e-^(u(t )u(t + t))dt = (u 2 ) . - (2.92) 
Jo 10J + 7(c<j) 

and therefore the FDR 

X (u) = — \ (u(t )u(t + t)) e— * dt (2.93) 
m{u z ) Jo 

is recovered. Note also that Eq. (2.92) allows us to calculate the power spec- 
trum of u(t) at equilibrium, i.e. 

S u (u;) = [°° e-^(u(t )u(t + t))dt = (u 2 ) 2l ^l (2.94) 



A particular case of Eq. (2.89) is the equation governing the charge Q(t) 
contained in a condenser of capacity C, in a simple RC circuit without any 
externally applied electromotive force: 
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being rj(t) a noisy internal electromotive force due to the interactions with a 
thermostat at temperature T. A series of experiments by Johnson [?], sup- 
ported by the theory of Nyquist [?], demonstrated the existence of such spon- 
taneous fluctuations of electric tension at the edges of the resistor u = Q/C, 
due to the thermal motion of charge carriers. The measured quantity in the 
experiment was the power spectrum of these tension fluctuations, i.e. S u (cu). 
The above equation for the RC circuit can be written in the form 

du u(t) .. . . n . 

~dt ~ ~Rj& + (2 - 96) 

with rj'(t) = rj/RC. This is equivalent to Eq. (2.89) with 7(4) = -^6(t), i.e. 
7(0;) = -fig, resulting in 

s ^> = <* 2 >TTW < 2 ' 97) 

The energy of the capacitor is E = Q 2 /2C, and the equipartition of energy, re- 
quired at equilibrium, imposes that (E) = which yields (u 2 ) = (Q 2 )/C 2 = 
2(E) /C = k B T/C. This result, put into Eq. (2.97), gives the spectrum of the 
Johnson-Nyquist noise 

At low frequencies, u <^ 1/RC, the power spectrum becomes constant and 
does not depend on the capacity of the circuit: 

S u (u) ~ 2Rk B T. (2.99) 



For a modern linear response study of chaotic systems in frequency domain 
we refer the reader to [?]. 



2.4-2 The Onsager regression hypothesis 

In his two seminal papers of 1931 [?,?], Onsager presented his regression hy- 
pothesis: "... the average regression of fluctuations will obey the same laws as 
the corresponding macroscopic irreversible process" [?]. This principle states 
the equivalence between the law governing the relaxation of spontaneous devi- 
ations from equilibrium and the law obeyed by the corresponding irreversible 
process, which is triggered by an initial small deviation from equilibrium. The 
fluctuation-dissipation theorem (2.16), justifies this hypothesis in a natural 
way. 

Onsager referred to the relaxation of a macroscopic variable a(t), an observable 
function of the microscopic degrees of freedom, a(P(t), Q(£)), whose equilib- 
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rium average, ceo is given by 



a = («(P, Q)> = /d p dQe - /JW ( Pl Q) (2-100) 

with the unperturbed Hamiltonian H(P,Q). Fluctuations around this value 
are denoted by Sa(t) = a(t) — ao- The average regression at time t\ of a fluctu- 
ation 5a(to), at time to, is given by the autocorrelation function (Sa(to)Sa(ti)) . 
The self-correlation function depends only on the difference t\ — to, since we 
are considering a time-translation invariant (equilibrium) state, therefore in 
the following we take t — and t 1 = t. 

The irreversible processes considered by Onsager, on the other hand, consist 
of the average evolution of the observable a(t), with t > 0, when a small 
perturbation AH is applied to the Hamiltonian from time — oo up to time 0, 
and then is switched off. This corresponds to a perturbation of the Hamilto- 
nian AH = — JF«(P,Q), so that the conjugated field of the perturbation is 
cc(P, Q) itself. The average evolution for times t > (the so-called "after-effect 
function" ) is given by 

JdPdQe^™+^™a(P,Q) 
a[ ) J rfPrfQe^ w ( p 'Q)+ AW ( p >Q) ' ^.luij 

Furthermore, the perturbation F(t) = FQ(—t) is such that a(0) — a = 5a(0). 
The regression hypothesis can therefore be formulated in the following way: 

a(t)-a _ {5a(t)5a(0)} _ (a(t)a(O)) - oj , . 

5(0) - a ((MO)) 2 ) (« 2 > - «o ' 



By definition, the irreversible evolution in the l.h.s. is governed by macroscopic 
linear laws, as discussed in Onsager's two 1931 papers, so that the fluctuation- 
dissipation theorem (2.16) can be used to compute a(t). For this purpose, 
it is convenient to consider H. + A7i as the unperturbed Hamiltonian, with 
ensemble averages given by (...)a«, and —AH as the perturbation switched 
on at time 0. From (2.16) one gets: 

a(t) = (a) An + (3F f dt'(a(0)a(t - t')) An = 
Jo 

(a) ah + PF[{a(t)a(0))M - {a 2 ) ah]- (2.103) 

At t — one has (a) ah — a o + Sa(0). Asymptotically, for t — > +oo, one 
has a(t) — > ao, and (a(t)a(0))A'H — > ((«)a«) 2 , which, substituting in (2.103), 
gives pF(a 2 ) A H = PF((a)An) 2 + Sa(0). With these relations, Eq. (2.103) 
becomes 

= a + /3F[(a(t)a(0)) AW - ((«)aw) 2 ]- (2.104) 
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It is now plain that, to be consistent with the linear approximation, all the 
effects of the perturbation AH, can be neglected in the functions appearing in 
the r.h.s, which are of second order in a. This means that all the subscripts 
in the perturbed averages (...)ah can be dropped and formula (2.104), i.e. the 
regression hypothesis, turns out to be a particular case of the Fluctuation- 
Dissipation theorem. 



2.4.3 The Onsager reciprocal relations 

In [?,?], Onsager derived a relation among off-diagonal elements of the evolu- 
tion matrix for linear irreversible processes. It was, in fact, the central result 
of that work. Again, it is possible, a posteriori, to offer a simpler derivation 
of that relation, starting from the Green-Kubo formulas. As we have seen, 
a direct consequence of FDR is the possibility to write the transport coeffi- 
cients as time-integrals of suitable correlation functions. In general, if one has 
iV conserved quantities, aj(x, t), i = (1, ..N), and small spatial and temporal 
variations of the fields, a linear system of evolution equations can be written 
as 

^^ = -V-J l (x,t) (2.105a) 
J l (x,t)=L lJ x J , (2.105b) 



where the fluxes Jj, the transport coefficients and the thermodynamic 
forces Xj have been introduced. The latter are the forces conjugated to the 
fluxes in the dissipation function (entropy production) of non-equilibrium ther- 
modynamics [?]. A thermodynamic force Xj is i n general a gradient of the same 
quantity Q!j(x, t): this is the application of linear response theory to internal 
forces, in fact the fluxes are responses to internal gradients. For instance, the 
heat flux q x along the x direction is expressed as q = —k8 x T with k the ther- 
mal conductivity. Note that for each flux-force pair the coefficient is 
indeed a matrix of indexes (k, I) for all possible pairs of the Cartesian compo- 
nents, i.e. Lij = (Lfj) with k,l = x,y,z. We recall the Green-Kubo relations 
for these coefficients: 

roc 

L%=(3Vj o ds{Jlit)j]m. (2.106) 

Onsager's reciprocal relations between Vf- and L 1 ^ appears as a consequence 
of microscopic time reversibility. The equations of motion for the evolution of 
a phase space point (describing a system of N particles) are invariant for the 
time reversal operation 7, which transforms Q — > Q, P — > — P and t — > —t. 
This invariance implies the invariance of the phase space probability measure. 
Denoting by S* the time evolution operator, which satisfies IS 1 = S^I, the 
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following chain of identities holds for a generic time correlation function: 

<MVj> = (/{[^Jf]Jj» = ([5-'/J*]/^> 

= ([S'/J^jf) = /^-([^Jj] Jf>, (2.107) 

where the invariance to a translation of time has also been used. In the last 
passage, we have exploited the fact that the fluxes have the opposite parity 
of their conjugated density under time reversal, so that IJf = UJf where 
Jj = ±1, for example heat and mass fluxes are odd, while the momentum flux 
is even. From the above identities, the reciprocal relations follow: 

Lg = l;l jl.j'i- (2.108) 



3 Fluctuation dissipation in chaotic systems and statistical physics 

The Fluctuation-Response theory was originally developed in the context of 
equilibrium statistical mechanics of Hamiltonian systemsf?,?]. In this Section 
we will show that a generalized FDR holds under rather general hypothe- 
ses[?, ?,?,?]: hence also for non-Hamiltonian systems. For instance, it holds for 
a vast class of systems with chaotic dynamics, something that is particularly 
relevant in hydrodynamicsf?,?]. 

Usually the Fluctuation-Response problem has been studied for infinitesimal 
perturbations; in many problems of statistical mechanics this is not a serious 
limitation. However, it is possible to see that a FD relation holds also for 
finite perturbations. This is important in different contexts, e.g. in geophysical 
or climate investigations, where the study of small perturbations is rather 
academic, while the relaxation of large fluctuations due to fast changes of the 
parameters is an issue of practical relevance [?]. In the following we derive a 
FDR which is valid independently of the number of degrees of freedom. 



3.1 Chaos and the FDR: van Kampen's objection 

Van Kampen argued that the usual derivation of the FDR, based on a first- 
order truncation of the time-dependent perturbation theory for the evolution 
of probability density, is not fully justified [?]. In a nutshell, using the dy- 
namical systems terminology, van Kampen's argument can be summarized as 
follows. Given a perturbation <5x(0), on the state of the system x(0) at time 
0, one can write a Taylor expansion for the difference between the perturbed 
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and the unperturbed trajectories at time t, 5x.(t), whose components are: 



= E Q^j Sx M + °(l^(°)l 2 ) • (s- 1 ) 

After averaging over the initial conditions, one obtains the mean response 
function: 



Ri,j(t) - 




In a Hamiltonian system one has p(x) oc expy — /3H(x) J , so that, integrating 
by parts, we obtain 

which is nothing but the usual FDR [?,?]. 

In the presence of chaos the terms dxi(t)/dxj(0) grow exponentially as e xt , 
where A is the Lyapunov exponent, therefore it is not possible to use the 
linear expansion (3.1) for a time larger than (1/A) ln(L/|5x(0)|), where L is 
the typical fluctuation size of the variable x. Such an argument suggests that 
the linear response theory is valid only for extremely small and unphysical 
perturbations or for short times. Indeed, according to van Kampen's argument, 
the FDR holds up to Is if a perturbing electric field smaller than 10~ 20 V/m is 
applied to the electrons of a conductor, in clear disagreement with experience. 

The possible repercussions of van Kampen's arguments are summarized by the 
following two sentences [?]: The basic linearity assumption of linear theory is 
shown to be completely unrealistic and incompatible with basic ideas of statisti- 
cal mechanics of irreversible processes; and Linear response theory does provide 
expressions for the phenomenological coefficients, but I assert that it arrives 
at these expressions by a mathematical exercise, rather than by describing the 
actual mechanism which is responsible for the response. These observations 
stimulated further research which resulted in a deeper understanding of the 
physical mechanisms underlying the validity of the FDR and of its range of 
applicability. 

As a matter of fact, the success of the linear theory for the computation of 
the transport coefficients (e.g. electric conductivity), in terms of correlation 
functions of the unperturbed systems, is transparent, and its validity has been, 
directly and indirectly, tested in a huge variety of cases. To reconcile van Kam- 
pen's argument with the well established linear response theory, note that van 
Kampen considered single trajectories, while the FDR deals with observables 
quantities, which are averages over ensembles of trajectories, and have a much 
more regular behavior than the single trajectories. Indeed, the reason of the 
seemingly inexplicable effectiveness of the Linear-Response theory lies in the 
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"constructive role of chaos" because, as Kubo observed, "instability [of the 
trajectories] instead favors the stability of distribution functions, working as 
the cause of the mixing" [?]. 



3.2 Generalized FDR for non Hamiltonian systems 

In the following we will give a derivation, under rather general hypotheses, of 
a general FDR, which avoids van Kampen's critique. Consider a dynamical 
system x(0) — > x(t) = S , *x(0) with states x belonging to a N- dimensional 
vector space. For the sake of generality, we consider the possibility that the 
time evolution be not completely deterministic {e.g. it could be described 
by stochastic differential equations). We assume that the system is mixing 
and that the invariant probability distribution p(x) enjoys some regularity 
property (see later), while no assumption is made on N . 

Our aim is to express the average response of a generic observable A to a 
perturbation, in terms of suitable correlation functions, computed accord- 
ing to the invariant measure of the unperturbed system. The first step is 
to study the behavior of a single component of x, say Xi, when the system, de- 
scribed by p(x), is subjected to an initial (non-random) perturbation x(0) — > 
x(0) + Ax 1 . This instantaneous kick modifies the density of the system into 
p'(x), which is related to the invariant distribution by p'( x ) = P( x ~~ Ax ). 
We introduce the probability of transition from x at time to x at time t, 
^(xq, — > x, t). For a deterministic system, with evolution law x(t) = ^^(O), 
the probability of transition reduces to VF(x , — > x, t) = 5(x — S^xo), where 
£(•) is the Dirac delta function. Then we can write an expression for the mean 
value of the variable Xi, computed with the density of the perturbed system: 



The mean value of Xi during the unperturbed evolution can be written in a 
similar way: 



Therefore, defining 5xi = (xi)' — (x^, we have: 



The study of an "impulsive" perturbation is not a severe limitation, for instance 
in the linear regime the (differential) linear response describes the effect of a generic 
perturbation. 




(3.4) 




(3.5) 
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5xi (t) 



Xi ^—^ — ^ p(x )W(x , — > x, t) <ix(ix 

Pl x o) 

F(x ,Ax ) 



(3.6) 



where 



F(x ,Ax ) = 



p(x - Ax ) - p(x ) 
p(*o) 



(3.7) 



Note that the system is assumed to be mixing, so that the decay to zero of 
the time-correlation functions prevents any departure from equilibrium. 

For an infinitesimal perturbation <5x(0) = (Sxi(0) ■ ■ ■ 5x^(0)), the function in 
(3.7) can be expanded to first order, if p(x) is non- vanishing and differentiable, 
and one obtains: 



3S(0 = -E(*«<')^ 



>^(0) 



t=o/ 



(3.8) 



which defines the linear response 



R id (t) = -(x i (t) 



din p(x) 



dxj 



(3.9) 



t=oi 



of the variable X{ with respect to a perturbation of xj. One can easily repeat 
the computation for a generic observable A(x), obtaining: 



m(o = -E(^( x (*)) 



(9 In p(x) 

dx; 



)5x j (0) 



(3.10) 



t=o/ 



In the above derivation of the FDR, we did not use any approximation on the 
evolution of <5x(t). Starting with the exact expression (3.6) for the response, 
only a linearization of the initial perturbed density is needed, and this implies 
nothing but the smallness of the initial perturbation. From the evolution of the 
trajectories difference, one can indeed define the leading Lyapunov exponent 
A, by considering only the positive quantities |<5x(t)|, so that at small |5x(0)| 
and large enough t one can write 

ln|<Jx(*)|^ ~ln|5x(0)| +Xt . (3.11) 

Differently, in the derivation of the FDR, one deals with averages of quantities 
with sign, such as 5x(i). This apparently marginal difference is very important 
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and underlies the possibility of deriving the FDR without incurring in van 
Kampen's objection. 

At this point one could object that in chaotic deterministic dissipative systems 
the above machinery cannot be applied, because the invariant measure is not 
smooth. 2 In chaotic dissipative systems the invariant measure is singular, 
however the previous derivation of the FDR is still valid if one considers per- 
turbations along the expanding directions. In addition, one is often interested 
in some specific variables, so that a projection is performed, making irrelevant 
the singular character of the invariant measure. For a mathematically oriented 
presentation of these ideas, related to a class of particularly well behaved dy- 
namical systems, see [?]. In these general response function has two 
contributions, corresponding respectively to the expanding (unstable) and the 
contracting (stable) directions of the dynamics. The first contribution can be 
associated to some correlation function of the dynamics on the attractor (i.e. 
the unperturbed system). This is not true for the second contribution which 
is very difficult to extract numerically [?]. Nevertheless, a small amount of 
noise, that is always present in a physical system, smoothens the p(x) and 
the FDR can be derived. We recall that this "beneficial" noise has the impor- 
tant role of selecting the natural measure, and, in the numerical experiments, 
it is provided by the round-off errors of the computer. Then, although the 
introduction of noise in a deterministic framework may look unjustified, the 
assumption on the smoothness of the invariant measure along the unstable 
manifold still allows us to avoid subtle technical difficulties, as confirmed by 
Ruelle's work [?]. 

We further observe that these dynamical mechanisms, which work equally well 
in low and high dimensional systems, do not need to constitute the main reason 
for which p can be assumed to be smooth, in systems of physical interest. 
Indeed, in systems of many particles, the projections from high dimensional 
phase spaces to a low dimensional space, is the main reason for dealing with 
smooth distributions. 

In Hamiltonian systems, taking the canonical ensemble as the equilibrium dis- 
tribution, one has hip = —0H(Q, P) + constant. If Xi denotes the component 
qk of the position vector Q and Xj the corresponding component pk of the mo- 
mentum P, Hamilton's equations (dqk/dt = dH/dpt) lead to the usual FDR 



In non Hamiltonian systems, where usually the shape of p(x) is not known, 

2 Typically the invariant measure of a chaotic attractor has a multifractal character 
and its Renyi dimensions d q are not constant [?]. 





(3.12) 
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relation (3.9) does not give very detailed information. However it shows the ex- 
istence of a connection between the mean response function R it j and a suitable 
correlation function, computed in the non perturbed systems: 

(xi(t)fM0))) > AW = -^f > ( 3 - 13 ) 

where, in general, the function fj is unknown. Let us stress that in spite of the 
technical difficulty for the determination of the function fj, which depends on 
the invariant measure, a FDR always holds in mixing systems, if the invariant 
measure can be considered "smooth enough" . We note that the nature of the 
statistical steady state (either equilibrium, or non equilibrium) plays no role 
at all for the validity of the FDR. 

In the case of a multivariate Gaussian distribution, In p(x) = — | cii,j%i%j J r 
const, where {ctj,j} is a positive matrix, and the elements of the linear response 
matrix can be written in terms of the usual correlation functions: 

KM = E «i,fc(^(*)^(o)) • ( 3 - 14 ) 

An important nontrivial class of systems with a Gaussian invariant mea- 
sure is the inviscid hydrodynamics, where the Liouville theorem holds, and 
a quadratic invariant exists, see Section 4.1. 

3.3 FDR, chaos and molecular dynamics 

It is not necessary to stress further the relevance of the FDR for the numerical 
investigation of the transport properties: via a molecular dynamics simulation 
one can compute the equilibrium correlation functions and therefore, using 
the Green- Kubo formula, the transport coefficients of liquids models with- 
out the introduction of any simplifying assumption. This approach has been 
successfully used in seminal works [?,?,?]. 

Another method which is more fundamental, from a conceptual point of view, 
but rather simple is to use directly the definitions of transport coefficients: 
one perturbs the system with an external force or imposes driving boundary 
conditions (e.g. a shear) [?,?,?,?] and observes the relaxation process. For such 
a problem, van Kampen's objection is relevant, to some extent. For example 
in numerical simulations, R^iif) is obtained by perturbing the variable Xj at 
time t — to with a small perturbation of amplitude Sxi(0) and then evaluating 
the separation 5xi(t\t ) between the two trajectories x(t) and x'(£) which are 
integrated up to a prescribed time t\ = t + At. At time t = t\ the variable Xi 
of the reference trajectory is again perturbed with the same Sxi(0), and a new 
sample 5x.(t\ti) is computed and so forth. The procedure is repeated M ^> 1 
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times and the mean response is then evaluated: 

^^)4E M w^ • (3-15) 

In the presence of chaos, the two trajectories x(t) and x'(i) typically separate 
exponentially in time, therefore the mean response is the result of a delicate 
balance of terms which grow in time in different directions. A naive estimate 
of the error in the computation of Ri i(r) suggests an increase in time as 



'M 

where L(2) is the generalized Lyapunov exponent of order 2: 



(3.16) 



^-teHra) 1 )- (3 - 17) 

In the above equation <5x(r) is assumed infinitesimal, i.e. evolving according 
the linearized dynamics (in mathematical terms, 5x(r) is a tangent vector of 
the system) [?], and a lower bound for L(2) is given by 2A. Thus very large 
M seems to be necessary, in order to properly estimate this balance and to 
compute Ri t i(r) for large r. 

On the other hand, the numerical results obtained with molecular dynamics 
simulations show rather clearly that the presence of chaos does not introduce 
severe limitations in the range of validity of the FDR, in agreement with 
the intuition of Kubo and the derivation of the FDR in the previous section. 
For instance in [?,?], for an ion in liquid argon, a perturbing force of order 
10 5 eV/ cm has been used, and a rather good agreement has been obtained 
between the results produced perturbing the system and those deduced from 
the Green-Kubo formula. These results are not restricted to systems with 
a large number of degrees of freedom [?,?]. As a final technical remark we 
note that the error estimate given by (3.16) is rather conservative and the 
uncertainty is actually smaller (at least for r not too large). In [?] one can see 
that for t < T (where T is order of the correlation time) cm{t) first decreases 
and later increases exponentially, but with a rate different from 1/(2). Indeed 
it is not completely correct in this context to use at finite time the Lyapunov 
exponents (or analogous quantities), which are well defined only at very large 
times. 3 



3 The same subtle problem appears in the connection between the Kolmogorov- 
Sinai entropy, hxs (which is linked to the Lyapunov exponents via the Pesin for- 
mula[?]), and the variation rate of the coarse grained Gibbs entropy, tq. Detailed 
numerical computations show that typically the (often accepted) identification of 
the two quantities does not hold. The basic reason of this fact is in the asymptotic 
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3.4 Linear response theory, foundations of statistical mechanics and anoma- 
lous diffusion 



This section is devoted to a brief discussion of interesting, and still partly open 
issues involving the relation among linear response theory, the foundations of 
statistical mechanics and systems with anomalous diffusion. 



3.4-1 Linear response theory and the foundations of statistical mechanics 

In his celebrated book Mathematical Foundations of Statistical Mechanics, 
Khinchin obtained important results concerning the ergodic and mixing prob- 
lem in statistical mechanics, without recourse to the notion of metrical transi- 
tivity, required by the Birkhoff theorem [?] . The general idea of this approach, 
which will be considered also in Chapter 5, is that the systems of interest in 
statistical mechanics have a very large number of degrees of freedom and the 
important observables are not generic functions. 

In a system with many degrees of freedom and weak interactions among the 
particles 4 , consider an observable A which contains the coordinates of only 
one (or a few) particles. Khinchin has shown that the ergodic hypothesis for 
a quantity A, i.e. the validity of 

lim 1 f°° A(t)dt = (A) , (3.18) 

T^oo 1 Jo 

holds if the autocorrelation of A satisfies the relation 

\im(A(t)A(0)) = (A) 2 . (3.19) 

t^oo 

This result can be reversed, i.e. the autocorrelation C^it) = (A(t)A(0)) satis- 
fies (3.19) if Eq. (3.18) holds uniformly [?] 5 . 



(with respect to time) nature of hxs-, while is a quantity related to the short 
time behavior of a given system [?] . 

4 Kinchin considers a separable Hamiltonian system i.e.: 



A' 



H = ^F n (q n ,p n ) 



n=l 

It is reasonable to think that the result holds also in systems of particles interacting 
through a short range potential, as those studied in [?] for equilibrium statistical 
mechanics. 

5 Note that this result concerns the ergodic hypothesis for only the given observable 
A, which is much weaker than ergodicity in its strict technical meaning, indeed it 
holds only for specific observables, and in systems with many degrees of freedom. 
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On the other hand, we know that correlation functions are closely related 
to the response function, so it is quite natural to investigate the connection 
between ergodicity and linear response theory. In a series of papers [?,?,?,?,?] 
this problem has been discussed in detail. The main result is the possibility 
to connect ergodic or non ergodic behaviour to the response of a system to an 
external perturbation. One finds that, in a generic system, irreversibility, i.e. 
the validity of (3.19), is a necessary but not sufficient condition for ergodicity. 

Let us indicate, in a symbolic way, the variables which determine the macro- 
scopic state and the control parameters with {A} and {P}, respectively. If we 
perturb the system changing {P} at time t — 0, i.e. {P} — > {P} + {5P}Q(t) 
one has 

SAti) =6P f R(t')dt' (3.20) 
Jo 

where {R} indicates the (differential) response function. For the sake of sim- 
plicity, we assume (A) = 0. If ergodicity holds for the variable A, one has [?,?]: 



lim i ( T f R A {t - t')dtdt' = X a (3.21) 

T^oo I Jo JO 



where xa is the static susceptibility. The advantage of (3.21) over the usual 
condition for ergodicity, Eq. (3.18), is that both sides of (3.21) may be eval- 
uated, for specific models, knowing the unperturbed measure (or equivalently 
the Hamiltonian). In the linear response theory, for Hamiltonian systems, one 
has 

R A (t) = -jC A {t) = -±{A(t)A(0)) . (3.22) 

Denoting with Ra(z) and Ca(z) the Laplace transform of Ra^) an d CU(£), 
respectively, from (3.21-3.22), and using the condition (valid for differentiable 
variables) dCA(t)/dt — for t — 0, the limit T — > oo produces 

R a (0) + Ca(T)-^-^ Xa , (3.23) 

or in different form: 

R A (0) + zC A (z)\ z=0 = xa ■ (3.24) 

In general one does not know if (3.21), or its equivalent (3.24), holds. It is 
possible to show that the two equations hold and coincide if C A (t) approaches 
zero for large t in a fast way, so that 

roc 

/ C A (t)dt < oo . (3.25) 
Jo 

In other words, the condition that C A (t) — > for t — > oo is only necessary for 
ergodicity, while (3.25) is sufficient. Note that (3.25) is implied by the Green- 
Kubo formulae, when the {x} are finite quantities. The Khinchin theorem, 
on the other side, requires weak interactions among the components of the 
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system: this is no more guaranteed, in the general case, when Ca(£) can have 
a slow decay. 

In [?,?,?] one can find a detailed discussion on different systems (including 
monatomic chains, oscillator models, chains with impurity, etc.) where the 
powerful recurrence relations method can be successfully applied and it is 
possible to determine whether the condition (3.25) is valid or not. Consider, 
for instance, the case of a nearest-neighbor coupled harmonic oscillator chain 
of 2N + 1 atoms, with periodic boundary conditions, containing a tagged 
particle of mass M, while the remaining have mass m. In the N — > oo limit, it 
is possible to see that the validity of (3.25) depends on the value of A = m/M. 
If A is finite, the momentum of the tagged particle is an ergodic observable. 

3.4-2 The fluctation- dissipation relation in the case of anomalous diffusion 

In recent years, many authors have shown that one can have anomalous dif- 
fusion in certain systems [?,?], i.e. one can have 

(x 2 {t)) ~t 2v with v± 1/2. (3.26) 

Formally this corresponds to-D = ooifz/>l/2 (superdiffusion) and D — if 
v < 1/2 (subdiffusion). 

Here we shall not discuss the different mechanisms at the origin of anomalous 
diffusion [?] . Our aim is to provide a short discussion of the following problem, 
which comes out in a rather natural way in presence of anomalous diffusion. 
We know, from Chapter 2, that, if in an unperturbed system (x(t)) = 0, in the 
cases with standard diffusion, i.e. with a finite positive diffusion coefficient, 
the response to a small external force is a linear drift 

x(t)~t, (3.27) 

where the overbar indicates the average over the perturbed system. One may 
ask how this scenario changes in presence of anomalous diffusion. 

As a consequence of the simple indentity 

(x 2 (t)) = f f C v {t x - t 2 )dt x dt 2 , C v {t x - t 2 ) = (u(tiMt 2 )> , (3.28) 
JO Jo 

and the fluctuation dissipation relation, one has the formal relation 

^-xJt)=K fc v {t')dt' , (3.29) 
dt Jo 

where K is a constant depending on the physical details, whose value is not 
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relevant for our purpose. In the superdiffusive case, one has 

C v (t) ~t- a with a < 1, (3.30) 

and v — 1 — a/2. 

A straigthforward consequence of (3.29) seems to be 

~xjt)~t 2u . (3.31) 

On the other hand it is not difficult to realize that such a formal argument is 
not reliable. Let us consider again the previous discussion, i.e. take a system 
whose state is {A} and the control parameters are {P}. Consider a special 
value {P*} of {P} such that (3.25) does not hold. Now perturb the system 
changing {P} at time t — 0, so that {P*} — >■ {P*} + {5P}Q(t). In our case 
R v (t) = C v (t), taking t — > oo in (3.20), we have <5A(oo) = oo, if v > 1/2. The 
validity of such a result is highly questionable: for instance it is easy to obtain 
a finite result: 

M(^o) = (A) P * +SP - (A) p. . (3.32) 

Let us discuss separately the subdiffusive case [y < 1/2) and the superdiffu- 
sive case [y > 1/2). 



3.4.2.1 The subdiffusive case Some authors show that in the subdif- 
fusive case, the result (3.31) holds [?]. This has been explicitely proved in 
systems described by a fractional-Fokker-Planck equation. In the case of an 
overdamped particle, see Sect. 2.3.4, the usual Fokker-Planck equation is 



d 



-P( X ,t)=C FP P( X ,t) = - 



d (V'{x) 



d 2 



P(x,t) \+K 1 —P(x,t) 
mrji J ox z 



with Ki = k B T/mr]i. For V = one has 

(x 2 (t)} ~ 2K x t 

while for V = —Fx, 



x(t) 



mr/i 



-t, 



(3.33) 



(3.34) 



(3.35) 



which is nothing but the Einstein relation for such a system. The fractional- 
Fokker-Planck equation is given by 



d_ 

di 



P(x,t) 



C FP P(x,t) 



(3.36) 
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where now Cpp is defined as in (3.33) with the changes r\\ — > and K\ — > 
K 7 , and D^~ 7 is the so-called Riemann-Liouville fractional operator defined 
through: 



1-7 



f(x,t) 



1 d r* fix t') 
— ttt" / , ' ' dt' with < 7 < 1 , (3.37) 

r 7 dt Jo (t - t'y-^ ' - ' y J 



being IX7) the Euler gamma function. For V = one has a generalization of 
(3.34): 



and for V = —Fx, 

p p 

xit) ~ — r , (3.39) 

in other words, if we assume the relation K~ f = hsT/mr]^, one has: 



lF(x 2 (t)} 



*(t) = , (3.40) 

which generalizes the Einstein relation for the subdiffusive case. The investi- 
gation of charge carrier transport in seminductors [?] showed that, up to a 
prefactor, which could not be determined exactly, eq. (3.40) is indeed valid. 



3.4.2.2 The superdiffusive case This situation is much more delicate, 
and, as far as we know, the problem is still open. The difficulties are due to 
the fact that the mechanism for the anomalous diffusion is rather subtle and 
can be obtained only in systems with rather peculiar dynamics. For instance 
in deterministic chaotic systems with a fine tuning of the parameters [?,?]. 
Typically the following scenario holds: if for a certain value Pq = P* of the 
control parameters one has C v (t) ~ t~ a with a < 1 and therefore v > 1/2, a 
small perturbation P — > P p = P* + 5P restores the standard diffusion with 
v = 1/2. More complex is the case of non-chaotic systems, which also show 
anomalous diffusion [?], but it is not completely clear which perturbations 
restore normal diffusion. 

At first, the difference between P* and P* + 5P can appear a paradox, on 
the other hand a precise analysis of the problem shows that the anomalous 
behaviour for P = P = P* induces a sort of "ghost" for P = P p = P* + SP, 
which is reminiscent of the unperturbed anomalous behavior. For P — P p 
the correlation function C v (t) is integrable, however for t < t c (5P) (where 
t c (SP) — > 00 as 5P — > 0) one has C v (t) ~ t~ a , therefore the difference between 
the anomalous case (for Pq) and the standard diffusion (for P p ) appears only 
at very large time, leading to a large diffusion coefficent (diverging for 5P — > 
0) [?]. 
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With the above scenario one can try to give a solution to the problem. Let 
us denote by C^(t) and C^ p \t) the correlation function for P = P* and 
P p = P* + SP respectively. In the presence of anomalous behavior (i.e. when 
(3.25) is not valid) it is not possible to exchange the limits 5P — > and t — > oo. 
Since the relaxation time of the perturbed system is t c , Eq. (3.29) is valid only 
for t < t c , while for t > t C) Eq. (3.29) must be replaced by: 

^-xji) = K t Ci°\t')dt' + K f C { P\t')dt' . (3.41) 
at Jo Jt c 

As a consequence Eq. (3.31) holds in the range t < t c , while for larger times 
one has the standard result (3.27), with a different prefactor depending on t c . 
One can say that also in anomalous diffusion, a "ghost" for P* remains up to 
large but finite times t c . 

A detailed discussion of this problem for a dynamical model has been given 
in [?]. Both possibilities, that 5P — > before t — > oo, and that t — > oo before 
5P — > 0, have been considered. In the first case, one obtains x(t) ~ t 2u , for 
the response at large times; on the other hand, for any finite value of 5P, 
dx(t)/dt saturates to a finite value, that depends on the perturbation. The 
general scenario suggested in Eq. (3.41) is therefore verified. 



4 Some applications 

The FDR has been extensively used in equilibrium statistical mechanics. Ap- 
plications in near-equilibrium contexts are discussed in any advanced book 
dealing with transport phenomena. In this section we want to discuss how 
to use the FDR in less standard cases, namely non-equilibrium and non- 
Hamiltonian systems. 

4-1 Fluid dynamics 

The Fluctuation-Response theory was originally developed within the frame- 
work of equilibrium statistical mechanics of Hamiltonian systems, giving rise 
to some confusion and misleading ideas about its validity. For instance, some 
authors claimed that in fully developed turbulence (which is a non Hamilto- 
nian and non equilibrium system) there is no relation between spontaneous 
fluctuations and relaxation to the statistical steady state [?]. 

The confusion is due, at least in part, to terminology; for instance, at times 
the term FDR is used just for Eq. (3.14) which is valid in the Gaussian case. 
Nevertheless the FDR plays a role in analytical approaches to the statistical 
description of hydrodynamics, where Green functions are naturally involved, 
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both in perturbative theories and in closure schemes [?,?,?], as well as in other 
fields, like in geophysical or climate studies [?,?,?]. 



4-1.1 Interlude on Statistical Mechanics of Fluids 

The Navier-Stokes equations for the evolution of the velocity field v(x, t) of 
an incompressible fluid are: 

+ (v(x, t) • V)v(x, t) = -±Vp(x, t) + i/Av(x, t) + F(x, f) , (4.1) 

V-v(x,t) = 0, (4.2) 

where p(x, t) is the pressure in the point x at time t; p and v are the density 
and the kinematic viscosity of the fluid respectively. 

For a perfect fluid (i.e. v = 0) and in the absence of external forces (F = 0), the 
evolution of the velocity field is given by the Euler equations, which conserve 
the kinetic energy. Such a case may be easily treated within an equilibrium 
statistical mechanics framework, simply following the approach used for the 
Hamiltonian statistical mechanics [?]. Consider a fluid in a cube of edge L 
and assume periodic boundary conditions, so that the velocity field can be 
expressed in terms of Fourier series as follows: 

v(x,f) = lE4,r (4.3) 

with k = 27rn/L and n = (jii, ...,714), rij being integers and d the spatial di- 
mension. By introducing (4.3) in the Euler equations, and imposing an ultra- 
violet cutoff, u(k) = for k > K maX) one obtains a set of ordinary differential 
equations of the form: 

dY N 

= E A a bc Y b Y c (4.4) 

b,c 

where N ~ if^ is the number of degrees of freedom, and the variables 
{Y a } are a subset of the full Fourier spectrum {u(k)}. The incompressibility 
condition yields k ■ u(k) = 0, and the fact that u(k) is real yields u(k) = 
u*(-k). 

As a consequence of the energy conservation one has 

]- Ya = E = constant . (4.5) 

In addition, the coefficients A a b c have the properties A a t, c = A ac b , A a b c + 
A bca + A cab = 0, and incompressibility makes the Liouville theorem hold: 

(9 dY 
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so that the necessary ingredients for an equilibrium statistical mechanical 
approach are all present. Assuming, in analogy with the treatment of Hamil- 
tonian systems, a microcanonical distribution on the constant energy surface 
\ Ha Ya = E-> f° r l ar g e N it is easy to obtain the invariant probability density 
of Y a . 

Pinv{{Y a }) OC exp (~ E^) ^ 

and the energy equipartition < F a 2 >= 2-j| = . 

In two dimensions another quantity is conserved: the enstrophy | J |V x 
u(x, t)| 2 c£x which, in terms of the {Y a }, can be written as 

\ E k 2 a Y a 2 = n = const. (4.8) 

Z a 

Assuming a microcanonical distribution on the surface where both the energy 
and the enstrophy are constant, and taking the large N limit, one obtains 

P inv ({Y a }) ^exp-\ U E Yl + &E k 2 X) (4.9) 

Z ^ a a ' 

where the Lagrange multipliers fli and $2 are determined by E and Q. 

Other systems, like magnetohydrodynamic and geostrophic fluids, have quadratic 
invariants and obey the Liouville theorem in the inviscid limit. 6 In such sit- 
uations it is straightforward to generalize the previous results as 

Pinv({Y a }) oc exp I -Wa a , b Y a Y b j (4.10) 

\ a,b J 

where {a at b} is a positive matrix dependent on the specific form of the invari- 
ants and on the values of the Lagrange multipliers. 

A statistical steady state requires a forcing in the case of a viscous fluid, which 
results in: 

d \ N 

- + vK)Y a = E A abc Y b Y c + f a , (4.11) 

b,c 

instead of eq. (4.4). It is well known[?] that in 3-D the limit v — > is singular 
and cannot be interchanged with the limit K max — > oo, therefore the statistical 
mechanics of an inviscid fluid has a rather limited relevance for the Navier- 



6 Numerical results in 2D and 3D inviscid hydrodynamics, as well as in other invis- 
cid cases (e. g. magnetohydrodynamics) show that the systems described by the in- 
viscid truncated Eq. (4.4) with quadratic invariant, are ergodic and mixing[?,?]: ar- 
bitrary initial distributions of {Y a } evolve towards the multivariate Gaussian (4.10). 
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Stokes equations at very high Reynolds numbers. 7 In the v — > limit in 
presence of forcing at large scale (small k) one has an intermediate range, 
called the inertial range, which has neither pumping nor dissipation and shows 
a strong departure from equipartition [?,?]. Instead of < F a 2 >= const, one 
has < F a 2 >~ A;~ 7 where 7 ~ 11/3, the value 7 = 11/3 corresponding to the 
Kolmogorov spectrum 8 E(k) ~ /c~ 5//3 . 



4-1.2 A general remark on the decay of correlation functions 

Using general arguments, one could naively conclude that all typical corre- 
lation functions, at large time delay, have to relax to zero with the same 
characteristic time related to spectral properties of the operator C, governing 
the time evolution of the probability distribution P({Y},t): 

lp({Y},t)=CP({Y},t). (4.12) 

The argument goes as follows: let the time evolution of the system be described 
by ordinary differential equations dY a /dt = X a ({Y}) so that CP({Y},t) = 

-Eaw: ( X «({Y})P({Y}, *)) > for the system (4.11), where X a = E a ,b A abc Y b Y b - 

vk^Ya + f a . 9 Let us introduce the eigenvalues {a k } and the eigenf unctions 
{ip k } of C: 

Cip k = a k ^ k . (4.13) 

Of course vpo = P.i nv and a — 0; moreover the mixing condition requires 
that Rea k < for k = 1,2,.... Furthermore assuming that the coefficients 
{<?i, g 2 , ...} and {hi,h 2 ,...} exist, such that the expansion of the functions 
g({Y}) and h({Y}) are unique: 

9({Y}) = E 9kM{Y}) , K{Y}) = £ h k M{Y}) , (4.14) 

fc=0 k=0 



7 In 2D the use of conservative statistical mechanics has been proposed to justify 
some behaviors of real fluids, e.g. Jupiter's red spot and the formation of coherent 
structures [?,?]. This approach, although interesting, is limited to some specific 
two-dimensional situations. 

8 E{k)dk is the contribution to the kinetic energy of the wave numbers in the range 
[k, k + dk]. 

9 In the presence of white noise terms {r] a } in eq. (4.11), i.e. X a — > X a + r] a where 
{i] a } are Gaussian processes with < rj a (t) >= and < rj a (t)r]b(t') >= 2k ab 8{t — t'), 
one has to add to C the term[?] 

^. a 2 
2-. A » b dYa dY b - 
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one has 

C gJ {t) = Y.9kh k <^l>e^\ (4.15) 
fc=i 

where C gJ (t) =< g({Y(t)})h({Y(0)}) > - < g({Y}) >< h({Y}) >. For 
"generic", i.e. not orthogonal to ip 1: so that g 1 ^ and h x ^ 0, functions g 
and /, the quantity C g j{t) approaches zero at large time: 

Naively this argument seems to imply that in hydrodynamic systems all the 
correlation functions, C a ^(t) =< Y a (t)Y a (0) >, relax to zero with the same 
characteristic time for all k a , while one expects a whole hierarchy of character- 
istic times distinguishing the behavior of the correlation functions at different 
scales [?]. The paradox is, of course, only apparent since the above argument 
is valid only at very long times, i.e. much longer than the longest characteristic 
time, hence it tells nothing about systems with many different time scales. 



4-1.3 FDR in perfect fluids and in turbulence 

Although the inviscid fluid mechanics is not a Hamiltonian system, Eqs. (3.3) 
and (4.7) (or (4.9) in 2D) make the FDR take the simple form 

«•> = <417) 

because of the Gaussian statistics. To the best of our knowledge, Kraichnan 
was the first to realize that the FDR may hold in a non Hamiltonian con- 
text [?,?]. As a matter of fact, in the case of turbulence the scenario is not too 
simple for two reasons: 

a) the (unknown) invariant measure is not Gaussian 

b) the degrees of freedom {Y a } are not independent. 

Nevertheless the general result discussed in Section 3 suggests that a relation 
between response and a suitable correlation function must exist. Indeed, also 
in turbulence there are many degrees of freedom, which are likely to yield a 
smooth distribution, when projecting on lower dimensional spaces, as required 
for the FDR. 

The FDR plays an important role in the statistical closure problem, which has 
to be tackeld by any non linear theory. In our case the evolution equations for 
C aa (t) =< Y a (t)Y a (0) > have the form 

(f t + vkl)c aa = F a (C^) (4.18) 

where F a is a function of the third-order correlations i.e. of terms like 
< Y a (t)Y b (0)Y c (0) >. In the equations for the fourth-order correlations 
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c< 4 > appear, and so on. An analogous situation occurs in the kinetic the- 
ory of gases, with the Bogolyubov-Born-Green-Kirkwood-Yvon hierarchy [?]. 
Experience has shown that it is quite efficient to truncate the hierarchy at a 
certain level, making some closure hypothesis. The simplest assumption in our 
case is the quasi-normal approximation, which assumes that the fourth-order 
cumulants vanish, i.e that 

< Y a Y b Y c Y d >=< Y a Y b >< Y c Y d > 

+ < Y a Y c >< Y b Y d > + < Y a Y d >< Y b Y c > . (4.19) 

Unfortunately the resulting set of equations gives unphysical results, such as 
negative E(k) for some k. Therefore it is necessary to introduce more precise 
hypotheses. One approximation which has been successfully used is the so 
called eddy-damped quasi-normal Markovian approximation, which takes into 
account the physical mechanism of the energy transfer [?]. 

An alternative approach is the direct-interaction-approximation (DIA) devel- 
oped by Kraichnanf?,?] which is one of the few self-consistent analytical tur- 
bulence theory so far discovered. In the DIA one writes separately equations 
for responses {R} and for correlations {C} 

(^ + ^2)C«,.(*,0 =^({C}, {R}) (4.20) 
(| + ^)iMM') = Ga({C},{R}) (4-21) 

where C a , a (t,t') =< Y a (t)Y a (t') >, R a , a (t,t') = 5Y a (t) / 5Y a (t') , T a and Q a arc 
(rather complicated) nonlinear integral expressions involving {C} and {R}. 
The DIA equations give the correct results (including the FDR in the form 
(4.17)) in the inviscid limit. In addition, for the "random coupling model", i.e. 

(j t + ^l)y a = T,K bc Y b Y c , (4.22) 

where A' abc = ±A abc with the sign varying randomly from triad to triad (a, b, c), 
Kraichnanf?] showed that DIA equations are exact. 10 Although the DIA 
equations (4.20,4.21) are closed, they are very complicated, so simplifications 
are usually introduced, like the so called Simple- Pole Model [?] where basically 
one assumes the FDR in its simplest form: 

C a , a (t, t') = R a , a (t, t')C a , a {t\ t>t'. (4.23) 



The DIA gives exact results also in other cases, e.g. in the large- N limit of the 
spherical model of turbulence [?] where the velocity field in (4.1) is now a vector 
with iV components, i.e. v G H, N , while x G R 3 . 
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It has been shown that renormalization group methods and the so called time- 
ordering approach [?,?] give the same results with an exponential form: 

C a , a (t, t') = C a , a (t', f ) e -"<*.>l*-f I t > t' , (4.24) 

R a a (t, t') = e - w ( fc -)( t -*') t>t', (4.25) 
with uj{k) ~ A; -2 / 3 in agreement with simple dimensional arguments. 

Note that Eq. (3.13) indicates that assumption (4.23) is equivalent to assume 
Gaussian statistics for {Y} without imposing a specific covariance matrix. 
Since it is well known, from both numerical and experimental results, that 
for very high Reynolds numbers, the statistics of the velocity fields is rather 
far from Gaussian, e.g. one has long tails in the PdF and intermittent behav- 
ior[?,?], eq.(4.23), or eqs. (4.24, 4.25), can not be completely correct. How- 
ever on intuitive grounds one expects the times characterizing the responses 
{R} to approximate the characteristic correlation times of {C}. Numerical 
investigations [?] at moderate Reynolds number of the DIA equations, show 
that R a , a (t,t') is not exactly proportional to C aja (t, £'), however comparing 
the correlation times Tc(k a ) (e.g. the time after which the correlation function 
becomes lower than 1/2) and the response time Tn(k a ) (e.g. the time after 
which the response function becomes lower than 1/2), one has that the ratio 
Tc{ka)/T~R(k a ) stays constant through the inertial range. 



4-1-4 Numerical results for simplified models 

Let us now discuss some numerical tests of the FDR in simplified models of 
fluid dynamics. Such systems are far from being realistic, but are nontrivial 
and share the main features of the Navier- Stokes, or the Euler equations. 
Consider the model [?]: 

dY n 

= y n +lKi+2 + Yn-lKi-2 — 2Y n +iYn-i (4.26) 

with n = (1, 2, N) and the periodic condition Y n+ N = Y n . This system, 
originally introduced as a toy model for chaos in fluid mechanicsf?], contains 
some of the main features of inviscid hydrodynamics: a) quadratic interactions; 
b) a quadratic invariant, E = \ X^Li ! c ) ^ ne Liouville theorem holds. For 
sufficiently large iV the distribution of each variable Y n is Gaussian. In this 
situation, the Gaussian-like FDR holds for each of the n variables, i.e. self- 
response functions to infinitesimal perturbations are indistinguishable from 
the corresponding self-correlation functions [?]. 

We can slightly modify the system (4.26) in order to have variables with 
different characteristic times; for instance, by rescaling the evolution time of 
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each variable [?]: 



dY n 

—jj- = k n ■ (Y n+1 Y n+2 + Y n _{Y n _ 2 — 2Y n+1 Y n _i) , (4.27) 

where the factor k n is defined as k n = a ■ f3 n , with (5 > 1, for n — 1, 2, N/2, 
with the "mirror" property k n+ N/2 = fcjv/2+i-n- F° r the system (4.27) a quadratic 
integral of motion exists: 

N y2 
n=l K ™ 

Moreover, if N ^> 1 the {Y n } variables preserve the Gaussian statistics with 
< Y n Y m >=< Y 2 > 5 nm oc k n . As a consequence the simplest FDR, i.e. 
Eq. (4.17), holds for each of the variables. On the other hand, at variance 
with the original system (4.26), each Y n has here its own characteristic time. 
Figure 1 shows the (expected) validity of (4.17), however the shape of C nn (t) 
changes with n. The correlation time of a variable Y n behaves as 

r c (k n )~k-V 2 . (4.29) 

The exponent of this scaling law can be easily explained with a dimensional 
argument, by noticing that < Y 2 >~ k n , and from (4.27) the characteristic 
time results to be just T C {k n ) ~ yj '< Y% >/{k n < F n 2 >) ~ k~ 3/2 . 

Let us now discuss more interesting cases, i.e. the chaotic dissipative systems 
with non Gaussian statistics, called "shell models" which have been introduced 
to study the turbulent energy cascade and share many statistical properties 
with turbulent three dimensional velocity fields [?,?]. Let us consider a set of 
wave-numbers k n = 2 n k with n = 0, . . . , N, and the shell-velocity (complex) 
variables u n (t) which must be understood as the velocity fluctuation over a 
distance l n = k~ x . In the following we present numerical results for a particular 
choice, the so-called Sabra model [?,?]: 

k n U* n+1 U n+2 + 6/c n _iM n+ iM*_ 1 + (1 + b)k n -2U n -2U n -l + fn 

(4.30) 

where b is a free parameter, v is the molecular viscosity and f n is an external 
forcing acting only at large scales, necessary to maintain a stationary tempo- 
ral evolution. We note that the shell models have the same type of quadratic 
nonlinearities as the Navier-Stokes equations in the Fourier space. In addition 
in the inviscid and unforced limit {v — f n — 0) the energy {\^2 n \u n \ 2 ) is 
conserved and the volumes in phase space are preserved. Because of the above 
properties, the set of coupled ordinary differential equations (4.31) possesses 
the features necessary to mimic the Navier-Stokes non-linear evolution. The 
main, strong, difference with the previous inviscid models (4.26, 4.27) is the 
existence of a mean energy flux from large to small scales, which drives the 
system towards a strongly non-Gaussian stationary state [?]. The shell models 
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Fig. 1. FDRs for the six fastest variables of the model (4.27), with TV = 20, a = 0.005 
and (3 = 1.7, n = 5,6,7,8,9,10. Thin lines represent the normalized correlation 
functions C n>n (t) / 'C„ )n (0) . Self-response functions R n , n are plotted with statistically- 
computed error bars. 

here discussed present exactly the same qualitative difficulties as the original 
Navier-Stokes eqs.: strong non-linearity and far from equilibrium statistical 
fluctuations. The most striking quantitative feature of the fully developed tur- 
bulence, i.e. the highly non-Gaussian statistics and the existence of anomalous 
scaling laws for the velocity moments, is reproduced in shell models, in good 
quantitative agreement with the experimental results[?,?]. One has: 

< \u n \ p >~ k-^ , (4.31) 

where ((p) ^ §C(^)> which implies that the velocity PDF's at different scales 
cannot be rescaled by any change of variables. 
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Let us now examine the numerical results concerning the response functions in 
the shell model [?]. Figure 2 shows the normalized diagonal responses, R nn (t), 
for k n in the inertial range, n e [7,14]. It is evident that the characteristic 
response time T R (k n ) decreases as k n increases. 

In Figure 3, one sees a clear difference between the response and the correla- 
tion function: this is an additional indication that the inertial-range statistics 
are very far from Gaussian. Although the R nn {t) do not coincide with the 
(normalized) C nn (t) / C nn (0) , the times T C {k n ) and r R (k n ) are not very dif- 
ferent Tc(k n ) oc r R (k n ), in agreement with the numerical result obtained by 
Kraichnan with the DIA at moderate Reynolds numbers [?]. In addition, one 
has a scaling behavior r R {k n ) oc Tc(k n ) ~ k~"' , where 7 is close to the value 
2/3 of the Kolmogorov scaling. 



4-2 Beyond the linear FDR and climate 

In the case of finite perturbations, the FDR (3.6) is typically non-linear in the 
perturbation Ax , and thus there are no simple relations analogous to (3.8). 
Nevertheless Eq. (3.6) guarantees the existence of a link between equilibrium 
properties of the system and the response to finite perturbations. This fact has 
a straightforward consequence for systems with a single characteristic time, 
e.g. a low dimensional system: a generic correlation function gives information 
about the relaxation time of finite size perturbations, even when the invariant 
measure p is not known [?]. We saw that in systems with many different 
characteristic times, such as the fully developed turbulence, one has a more 
complicated scenario: different correlation functions show different behaviors. 
For a finite perturbation 5x(0) such that A(x(0) +5x(0)) - A(x(0)) = SA(0), 
instead of (3.10) one has: 



6A(t) = (A(x(t))F(x(0),6x(0))), (4.32) 

therefore the relaxation properties depend explicitly on the initial perturbation 
5x(0) and not only on the value of 5A(0). In the following we will discuss the 
relevance of the amplitude of the perturbation, which may play a major role in 
determining the response, because different amplitudes may trigger different 
response mechanisms with different time scales [?,?]. 



4-2.1 Response to finite perturbations 

Consider two cases with a single characteristic time: a low dimensional deter- 
ministic chaotic system, known as the Lorenz model, and a nonlinear Langevin 
equation. We begin with the Lorenz model [?]: 
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Fig. 2. Response functions, R n ,n(t), for shells n = 7, 8, . . . , 13, 14 (from top to bot- 
tom). Error bars are shown only for the smallest and the largest scales. The param- 
eters in eqs. (4.30) are b = 0.4, v = 5.10 -7 , and N = 25. 



with standard parameters for chaotic behavior: b = 8/3, a = 10 and r = 28. 
The correlation function of the variable z, shown in Figure 4, qualitatively 
reproduces the behavior of the response to different sizes of the perturbation 
of the z variable, ranging from infinitesimal ones up to those of the size of the 
attractor. The agreement between the response function and the normalized 



dx 

~dt 

dy 

dt 

dz 

~dt 



xy — bz 



a(y-x) 



—xz + rx — y 



(4.33) 
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Fig. 3. Comparison between the averaged Response Function, R nn (t), (top) and the 
(normalized) self-correlation, C njJl (t)/C nn (0) (bottom) for the shell n = 10. 

correlation function is just qualitative and it does not depend too much on 
the amplitude of the perturbation, because the invariant distribution is not 
Gaussian (see inset of Fig. 4) and the general correlation (3.13) should be 
used. 

To better illustrate this point, we consider a system whose invariant proba- 
bility distribution is known. In this case, we can quantitatively compare the 
differences between the responses to infinitesimal and finite perturbations. Let 
us consider the stochastic process x(t) described by 




(4.34) 
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Fig. 4. Normalized correlation function of the z variable of Lorenz model (solid line) 
compared with the mean response to different perturbations of the same variable. 
Sz = 10~ 2 a (dashed line), 5z = a (dotted line), with a 2 = (z 2 ) - (z) 2 = 75.17. In 
the inset the invariant probability p(z) versus z. Being a ID projection, p(z) results 
regular, even if the full 3D distribution is fractal. 

where rj(t) is a white noise. The invariant probability distribution is [?]: 




(4.35) 



where Af is fixed by normalization, and 




(4.36) 
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The resulting pdf, shown in the inset of Fig. 5, has a Gaussian core, with 
exponential tails. Figure 5 also shows the response function for an infinites- 
imal and for a finite size perturbation. For both perturbations, the response 
function measured from the perturbed trajectories is exactly predicted by the 
statistics of the unperturbed system according to (3.13), while the Gaussian 
correlation C(t) = (x(t)x(0)) / a 2 is only an approximation of the response. By 
construction, the pdf of this system has larger tails than in the Gaussian case, 
thus large fluctuations have slower decay than small ones. On the contrary in 
the Gaussian case, i.e. U(x) = \x 2 for any x, the response is an exponential 
function and does not depend on the amplitude of the initial perturbation 
Sx(0). 

We have already seen how in systems with many characteristic times, different 
correlation functions behave differently and a variety of time scales emerges, 
which correspond to the different decay times of the correlation functions. In 
addition, at variance with systems with a single time scale, the amplitude 
of the perturbation plays a major role in determining the response, because 
different amplitudes affect features characterized by different time scales. To 
illustrate these ideas, we refer to the shell model (4.30) and consider the total 
energy E(t) = \ Y,n=i l M n(^)| 2 which is conserved in the inviscid, unforced limit 
[?]. We study the response to perturbations of E with different amplitude, of 
the following form: 

... f , 1< n < % - 1 

l*#>(0)| = \ ' ~ ~ . (4.37) 



u n \ 2 ) ,i<n<N 

The value of % = l,--,N determines the largest spatial scale I of the per- 
turbation, t ~ k~ x . This corresponds to a set of initial perturbations of the 
energy 

1 N 

*£ (0 (o) = 2E<KI 2 >- ( 4 - 38 ) 

n=i 

Such a kind of perturbation is motivated by the fact that, in the unper- 
turbed system, the energy is distributed among the shells according to the 
Kolmogorov scaling (\u n \ 2 ) ~ k~ 2 / 3 , and the smaller scales give smaller con- 
tributions to the energy E(t). Thus it is natural to assume that a small per- 
turbation of the energy affects mainly the small scales. 

For each perturbation 5E^(0), the average energy response 



RE{t) ~ IeW) (439) 

reveals a behavior similar to the correlation function of the largest perturbed 
shell Ui(t), as shown in Fig. 6. An additional measure of the relaxation time 
is provided by the halving times T h of the mean response, when 8E^{T h ) = 
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Fig. 5. Response of the stochastic differential equation (4.34) with D = 1 and 
U(x) as in (4.36), to different perturbations: large 5xq = 2.3a (+) and infinitesi- 
mal 5xo = 7.6 x 10~ 3 <7 (x). In both cases the mean response is exactly predicted 
by the correlation function < x(t)f(x(0)) >, with f(x) given by (3.6,3.7), dashed 
line for 5xq = 2.3a and dotted line for 5xq = 7.6 x 10 -3 . The correlation func- 
tion (x(t)x(0))/a 2 (solid line) is shown for comparison. In the inset the invariant 
probability distribution p{x)a versus x/a with a 2 = (x 2 ) — (x) 2 = 1.15. 

^SE^(0). The dependence of the halving times on the amplitude of the initial 
perturbation reflects the Kolmogorov scaling for characteristic times. Noting 
that T C (k n ) ~ r R (k n ) ~ k~ 2/3 ~ u 2 n ~ 6E®(0) one has: 

T h ~5E®(0). (4.40) 

The above results show that the response of a system with many characteristic 
times to a finite size perturbation may depend on the amplitude of the per- 
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turbation. Thanks to the applicability of the FDR, it is possible to establish 
a link between relaxation times of different perturbations and characteristic 
times of the system. 



Fig. 6. Mean response R.E(t) of the total energy E(t) = ^Y2\ u n\ 2 °f the shell 
model (4.30) to different amplitude perturbations: 5E^ 12 \0) = 5.5 x 10~ 3 (+), 
<5£( 14 )(0) = 1.7 x lCT 3 (x), <5£( 16 )(0) = 4.5 x 1(T 4 (*); and the (normalized) 
correlation functions of the corresponding largest perturbed shell: shell n = 12 
(solid line), shell n = 14 (dashed line), shell n = 16 (dotted line). 



4.2.2 FDR and climate 

One of the key issues in climate modeling is the study of the response to per- 
turbations of the external forces, or control parameters. In such a context, the 
importance of the FDR is rather obvious: if it holds there is the possibility, at 
least in principle, to understand the behavior of the system under perturba- 
tions (e.g. a volcanic eruption, or change of the C 2 concentration) in terms 
of the knowledge obtained from its past time history [?,?]. 

To describe the climate system, let us consider the symbolic evolution equa- 
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tion: 



dX 
~dt 



Q(X)+f(f) 



(4.41) 



where X is the state vector for the system, Q(X) represents complicated 
dynamical processes and f(t) the external influences. The average effect of an 
infinitesimal perturbation 5i (t) can be written in terms of the response matrix 
R a ,p{t)] if 5f(t) = for t < one has: 



The goal is to write R a> p{i) in terms of correlation functions of the unperturbed 
system. 

Under many points of view, the questions concerning the FDR in climate sys- 
tems are rather similar to those posed in fluids dynamics, because one deals 
with non Hamiltonian and non linear systems, whose invariant measures are 
non-Gaussian. On the other hand, in climate studies, one hardly faces equa- 
tions obtained from first principles, and typically it is necessary to work with 
rather crude models, or with experimental time series [?]. Moreover, in cli- 
mate problems and in geophysics, the interest in infinitesimal perturbations 
is rather academic, while the interesting problem is the behavior of the relax- 
ation of large fluctuations, due to sudden changes of the parameters. 

Starting from the seminal works of Leith [?,?], who proposed to employ the 
FDR to study the response of climatic systems to changes in the external 
forcing, many authors applied this relation to different geophysical problems, 
ranging from simplified models [?], to general circulation models [?,?] and to 
the covariance of satellite radiance spectra [?] . In most of these attempts, the 
FDR has been used in its Gaussian version, eq. (3.14), which has been acrit- 
ically considered a reasonable approximation, without investigating its limits 
of applicability. For a recent application to climate models with fast and slow 
variables see [?]. 

The results previously discussed show that a FDR holds also for non infinites- 
imal perturbations. This generalization of the usual linear response theory has 
an obvious interest for climate applications. Although the FDR in its simplest 
form (3.14) does not hold, one has, at least, a qualitative agreement between 
responses and correlations. In particular, from features of the unperturbed 
dynamics, one infers the presence of different response times associated with 
different variables. This description is qualitatively satisfactory. But a precise 
quantitative estimate faces difficult technical problems such as: 

a) the FDR involves the detailed form of the invariant probability distribution 
(which is usually unknown) 

b) non infinitesimal perturbations require good statistics to resolve the rare 
events. 




(4.42) 
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4-3 Granular materials 



Granular systems [?,?,?] constitute an example of non-equilibrium physics, 
pervading our everyday life: sand, sugar, coffee, pills, seeds, powders, etc., are 
all instances of the "granular state of matter". For the behavior of granu- 
lar systems, the environment temperature plays only a marginal role. At the 
same time these systems are made of relatively many particles. This suggests 
that statistical mechanical methods, such as kinetic theory, hydrodynamics, 
thermodynamics and linear response can be adapted to granular materials. 

A starting point of the statistical approach is to identify a distribution that is 
left invariant by the dynamics, as is the case of the microcanonical distribu- 
tion in Hamiltonian systems, and the conditions under which this distribution 
can be reached, starting from a generic initial condition. Unfortunately, sta- 
tistically steady states of granular matter are usually given by the balance 
of non-conservative forces, such as external tapping and inelastic collisions or 
friction with the boundaries, and the corresponding invariant measures are 
not known. It is therefore natural to ask whether it is possible to speak at all 
of a granular temperature. This question has different answers, depending on 
the degree of diluteness of the granular system under examination. The most 
straightforward definition comes from the case of dilute, strongly vibrated 
granular systems, which reach a non-equilibrium stationary state: by analogy 
with molecular g "granular temperature" T g can be defined in terms of 

the average local kinetic energy per particle. This approach can a priori be 
extended to denser, liquid-like, strongly vibrated systems [?]. However, if the 
density is further increased, or the external energy injection strongly reduced, 
the assumption of ergodicity becomes less and less obvious: reaching a sta- 
tionary state may become experimentally or numerically very difficult. Dense 
granular systems exhibit aging [?,?] and memory [?,?]. Analogies with other 
aging systems have also led to the definition of dynamic temperatures as quan- 
tifying the violation of the Hamiltonian version of the fluctuation-dissipation 
theorem [?]. In this review, we do not touch on non-ergodic statistical physics, 
hence we do not discuss glassy granular systems and we focus only on systems 
that rapidly forget their initial conditions. This class includes the so-called 
"granular gases" , i.e. granular systems which are fluidized by different means, 
for instance strongly shaking the container, or otherwise letting a low-density 
fluid (e.g. air) pass around the grains at high velocity. 

In Appendix A the reader can find a brief review of the models used for the 
granular gases. Such models include the following ingredients: a gas of par- 
ticles, a collision rule that dissipates kinetic energy, and a dynamical rule 
governing the dynamics between collisions. This dynamics depends upon the 
external forcing. If the system is driven from the boundaries (shaking the 
container) and gravity can be neglected, for example in microgravity exper- 
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iments, the bulk dynamics is made of straight paths plus inelastic collisions. 
If the container is large, the external energy may take a long time to reach 
the interior of the gas: this motivates the study of pure cooling models [?]. 
They are considered as the building blocks of the hydrodynamics of bound- 
ary driven granular gases [?] . For this reason, several authors have considered 
the application of the theory of linear response to perturbations of these sys- 
tems, as a valid alternative to kinetic theory, for the derivation of transport 
coefficients [?]. Here, the analysis is more difficult because there is no steady 
state, but only a scaling behavior towards a state with all the particles at 
rest, which undermines basic assumptions of kinetic theory, such as the sepa- 
ration of scales and the fast equilibration of microscopic modes [?,?]. On the 
other hand, experiments with uniform drivings, i.e. setups where the injection 
of energy reaches all grains, show a very rich phenomenology and are much 
easier to model: the gas reaches a statistically steady state and the formalism 
introduced in Sec. 3 can be applied. 



4-3.1 Cooling granular gases 

Most of the work devoted to linear response in cooling granular gases, concerns 
the calculation of transport coefficients for small perturbations of the homoge- 
neous cooling state, under different assumptions [?,?,?,?]. A well established 
approach [?,?] considers the Boltzmann equation for a granular gas as the 
starting point, see Appendix A, Eq. (A. 3) with T = 7 = 0, which describes 
the evolution of a single particle velocity distribution /(x, v,t), in a gas with 
particles interaction given by inelastic collisions, obeying the rule of Eq. (A.l). 
The effect of collisions is included in the collision integral, Eq. (A. 4). 

Following the standard kinetic theory procedure, it is possible to derive balance 
equations for the usual fields: 



D t n + nV • u = (4.43) 
Dm + {mn^VjPij = (4.44) 

D t T g + ^ {P lj V J u i + V • q) + T g ( = 0, (4.45) 

where n, u and T g are the density, velocity and temperature fields respec- 
tively, and D t = d t + u • V. The pressure tensor P^, the heat flux q and the 
cooling coefficient ( depend upon the particular (time dependent) form of the 
distribution function /(x, v,i). A homogeneous scaling solution / (x, v,t) = 
nv o d (t)fo( v / v o(t)) is supposed to exist: it has no x-dependence (homogene- 
ity) and the time-dependence is all included in the thermal velocity vo(t) = 
\j2T g (t)/m [?]. Such a solution must satisfy an equation for T g (t), which re- 
sults in the so-called Haff law [?] for the homogeneous granular cooling. At 
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large times, in the homogeneous case, the granular temperature decays as 
T g {t) ~ t-\ 



It is possible to express a generic perturbation of the scaling state fo in terms 
of the gradients of the macroscopic fields n(x, t), u(x, t), T s (x, t). Substituting 
this form in the Boltzmann equation and retaining only terms of first order 
in these gradients results in expressions for the pressure tensor and the heat 
flux, which are linear in the field gradients [?]: 



2 

Pij = p(x, t)Sij - rjiVjUi + ViUj - -Sij V • u) (4.46) 
q=- K VT g -iNn, (4.47) 



where /i is a new coefficient peculiar to granular gases, which vanishes in 
the elastic limit, and the following "Green-Kubo" relations hold, giving the 
transport coefficients: 



^) = ^/; W ^(S*M-*3>e* (4.49) 
Mi) = 2W) +! ^|W /*> (fa , (B . M . (# ._ #;)) . (450) 

Th CI J 



The transport coefficients depend upon the time t, which is related to the time 
s through the transformation ds = dtvo(t)/£, with £ the mean free path, i.e. 
s is proportional to the total number of collisions occurred since the initial 
time. In the above expressions the transport coefficients are obtained as time 
integrals of correlation functions calculated with the unperturbed distribution 
fo (the average (...) refers to this distribution). These are correlations between 
the currents at time s' 



D* J = V*V* - \v* 2 5ij 



S*= V 



*2 



d + 2 



V*, 



(4.51) 
(4.52) 



and new conjugated quantities at time 0: 
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2 ^'~2 [d ij ' <9V* 



d 



9 



In/* - V* \d + V* 



d 



(4.53) 
(4.54) 
(4.55) 



The rescaled peculiar velocity V* = (v — u(x, t))/v (t) and the rescaled cooling 
coefficient (* = (£/v have been used in the above expressions. In the elastic 
limit r — > 1, the unperturbed state /o becomes the Maxwell distribution, so 
that $* -> 0, $* -> £>* $* -> S*(V), and therefore 



^^^0 = 

2nm£v (t) 
d 2 + d-2 jo 



/t — > = 



n^u (t) 



r ds'(s*(s') -s*) . 

JO 



(4.56) 
(4.57) 

(4.58) 



The difference occurring in the granular case (r < I), with respect to the 
elastic case, are the following: the averages (...) are based on an invariant 
measure fo which is not Maxwellian; the conjugated currents at time are 
different from the fluxes S* and D*-, as expected from the non-Gaussianity 
of the unperturbed state and from the considerations of section 3. The time 
integration is replaced by an integration over the average collision number s, 
and contains an additional time dependent factor. This term arises from the 
change of the temperature over the duration of the integral. 



4-3.2 Driven granular gases 

The effect of a uniform driving acting upon all the particles of the granular 
gas is modeled assimilating the driving to a thermal bath, on the macroscopic 
scale of grains (see Appendix A for details). All the variants of this thermal 
bath model guarantee the achievement of a statistically stationary state after 
the time needed to forget the state in which the system has been initially 
prepared. The study of the FDR in these models is recent and has been car- 
ried out by means of numerical simulations [?,?,?,?]. Some of the numerical 
results has received an analytical interpretation in [?] , and experimental verifi- 
cations have been attempted in [?]. Other idealized models of inelastic energy 
exchange [?,?,?] have also been proposed. Some of the numerical results and 
their interpretation are reviewed here, in view of relation (3.9). We start with 
monodisperse weakly correlated systems, we continue with the bidisperse case, 
and we conclude with an analysis of the effect of strong correlations in dense 
systems. 
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Monodisperse gases with weak correlations 



A simple Fluctuation-Response experiment involving only one particle of a 
statistically stationary gas made of identical particles, consists in applying an 
instantaneous perturbation Sv o (0) to the rc-component of the velocity of that 
particle at a time (assumed to be in the stationary regime), and observing 
its relaxation averaged over many different realizations: 



If the invariant measure describing the statistically stationary state satisfies 
the following condition (the independence of the degrees of freedom) 

N d 

p({^x l }) = n N UUp v (v?), (4-60) 

i=l a=l 

where vf is the a velocity component of the i-th particle, with n = N/V, and 
if the single particle velocity pdf p v (v) is a Gaussian, then Eq. (3.9) predicts 

m = Cl(i) = MM2» (4 . 61) 

for the response function. If one of these assumptions does not apply, then 
relation (4.61) is no more expected to hold. 

The above recipe has been applied [?,?,?] to three monodisperse variants of the 
general model of driven granular gases of Appendix A, Eq. (A. 2), characterized 
by: 

• i) very dilute conditions in 2D, with volume fraction <f> = n^- < 0.1 (being 
a the diameter if the hard disks) and mean free time between collisions r c 
not much smaller than the viscosity time t& = 1/7; 

• ii) same as model i) but with the additional assumption that positions of 
particles are irrelevant and the probability of a collision is proportional to 
the relative velocity (Direct Simulation Monte Carlo, DSMC); 

• iii) same as model ii), with a constant collision probability (inelastic Maxwell 
model) and a deterministic driving. 

The last two variants are discussed in details in Appendix A. All these models 
have the common property (4.60) and non-Gaussian velocity pdfs p v (v). In 
particular model iii) displays p v (v) with high energy tails of the form v~ b with 
b = 4 in d = 1 [?,?] and b > 4 in d = 2 (a good estimate for not too high 
inelasticity is b ~ 4/(1 — r) [?]). The extreme simplification of the dynam- 
ics of model iii) allows us to obtain a direct analytical computation of time 
correlations and responses (see Appendix A). In Figure 7, some examples of 
the velocity pdfs for these different models are shown. In Molecular Dynamics 
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Fig. 7. Dilute cases, velocity pdf in different cases. 

(MD) simulations of inelastic hard disks, even if strongly inelastic, but still 
dilute (0 < 0.1), the velocity pdf is not far from a Gaussian, as in a DSMC 
with similar choices of the parameters (r c ~ 0.1r b ). Increasing n in the DSMC 
leads to stationary regimes very far from thermal equilibrium, with T g <C TJ, 
and larger tails of the velocity pdf p v (v). A convenient fit of these velocity 
pdfs is the following 

p v (v) = c exp(-dv 2 + c 2 \v 3 \ - c 3 i; 4 ) (4.62) 

where Co is the normalization constant. In most of observed cases |c3t>^ a J <C 
l^marr!) with v max the largest value of v in the histogram. Therefore, in prac- 
tice, we have a rather good fit even dropping the negative quartic term. Using 
relation (3.9) with the assumption of uncorrected velocities, a prediction for 
the response is obtained, in the form 

R(t) = -2 Cl (v x (t)v x (0)) + 3c 2 (v x (t)\v x (0)\v x (0)) (4.63) 
= -2ci<7#Ci(f) + 3c 2 (|^(0) 3 |)C 2 (t), (4.64) 

which also defines C 2 (t). 

Typical results of Fluctuation- Response numerical experiments on these three 
models are shown in Figure 8, together with the normalized velocity correla- 
tions Ci(t) and C 2 (t). The general picture that emerges from these numerical 
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Fig. 8. Dilute cases; experiment with instantaneous displacement of the velocity of 
a tracer. 

experiments is the following: 

• different correlations practically display the same behavior (we do not show 
C 3 (t) = (v(t)v 3 (0))/(v(0)' 1 ), but the result is similar) 

• a very good agreement between R(t) and C\ (t) is observed, which amounts 
to a verification, within the limits of numerical precision, of the Einstein 
relation. 

The observation that the self-correlations Ck(t) are almost identical, at least 
for k = 1,2,3, is very robust: indeed with large statistics one can appreciate 
very small differences only at late times. Anyway, the data on the response 
function is usually quite noisy, and, for the practical purpose of the linear 
combination involved in the response, these small differences are negligible: 
the Einstein relation is always satisfied, with T g as a proportionality factor. 
In conclusion, the coincidence between velocity correlations of different orders 
makes the non-Gaussianity of the velocity pdf irrelevant for the linear response 
of the system. 

It is interesting to note that an almost identical situation is encountered in 
a gas of non-interacting particles, whose velocities obey a Langevin equation 
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with a non-quadratic potential: 



dv(t) 
dt 



= -7 



dU(v) 



dv 



(4.65) 



with U(v) = C\V 2 — c 2 v \v\ 2 + c 3 f 4 (with positive ci, c 2 and c 3 ). Numerical 
inspection, clearly indicates that Ci(t), Czif) and Cs(t) are practically indis- 
tinguishable. 

A simple condition produces the observed behavior. In fact, the time correla- 
tion of v(t) with a generic function of the initial velocity /[i>(0)] can be written 

as 



where Vt(v t \vo) is the conditional probability of observing v(t) = v t if v(0) = vo 
(time translation invariance is assumed) and (i>t|i>o) = / dv t Vt(v t \v )v t is the 
average of v(t) conditioned to v(0) = v . 

If, for some reason, the dependence on time and on v(0) can be factorized, 
i.e. (t>t|t>o) = g(t)q(vo), with g and q two generic functions, then the time 
behavior results independent of the choice of the function f(v), i.e. of the 
order of the correlation. This happens in model (iii), where in spite of the 
non-Gaussian shape of the velocity pdf, the equivalence between R(t) and 
Ci(t), as well as any other correlation C f (t) = (v(t)f[v(0)})/(v(0)f[v(0)]} = 
R(t) = exp ^_ r ( r + 1 ) ^ ; with any generic function / of the initial velocity value, 
is exact for the case d = 2 and [?] for d — 1, see Appendix A. 

Let us discuss further experiments, with different kinds of perturbations, which 
involve more than one particle. A classical procedure, to avoid the heating of 
the system when a global perturbation is applied, is the following [?]: once 
a steady-state has been reached, the system is perturbed impulsively at time 
by a force applied (non-uniformly) on every particle. The response is then 
monitored in time. The force acting on particle % is 



with the properties V^ = 0, where Q is a particle dependent 

variable with randomly assigned ±1 values. A simple case is realized by a 
transverse perturbation £(r,t) = (0,£cos(k x x)5(t)), where k x is compatible 
with the periodic boundary conditions, i.e. k x = 2iink/L x with nk integer 
and L x the linear horizontal box size. The staggered response function (i.e. 
the current induced at t by the perturbation at time 0), and the conjugate 
correlation, 




(4.66) 



(4.67) 



(4.68) 
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R ( t ) = T(^Ciyi{t)coa(k x x i (t))) , 

^ i 

C(t) = (Zi/i(t)vM cos{k x [ Xi (t) - Xi (0)]}) 

i 

are related, at equilibrium, by the Kubo relation R(t,to) = |C(t,to), 7& = 
1/(5 being the bath temperature. It is possible to derive the same relation 
from Eq. (3.9) with the assumption of uncorrelated variables and Gaussian 
velocities, and replacing T b with T g of the perturbed species. In Figure 9, the 
results of such numerical experiment are shown in a parametrized form. The 
previous scenario is recovered: the Kubo relation is satisfied with T g replacing 



Fig. 9. Parametric plot of R(t — t w ) vs. C(t — t w ) for the numerical experiment with 
recipe II (impulsive shear perturbation) with r < 1, with heating bath, and for 
different choices of the wave number of the perturbation. T b = 1 and r& = 10, 
N = 500, t c = 1, S = 0.01, rik = 8, with averages over 10000 realizations, using 
t w = 100. 

The binary mixture and the granular thermometer 

In the binary mixture case, one analyzes a system made of two different com- 
ponents with Ni and iV2 particles, with masses mi and m 2 respectively, co- 
efficients of restitution «u and 0:22 for collisions among particles of the same 
species and olyi for collisions among particles of different species. Simulations 
as well as experiments and analytical calculations have shown that, in this 
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case, energy equipartition is broken, i.e. Ti ^ T 2 ^ T b [?,?,?,?,?]. At the level 
of Boltzmann kinetic equation, the temperature ratio of a binary granular 
mixture subject to stochastic driving of the form given above has been ob- 
tained in [?] for the case r y Si = and in [?] for j s . ^ 0. In the case r y Si ^ 
a bath temperature can still be defined as T5 = r Si 7 Si . Note that in general 
Y Si and r y Si depend upon rrii and the correct elastic limit (i.e. equipartition) is 
recovered if and only if TJ, does not depend on m,. In [?] it has been shown 
that a model with r Si oc v /m Si and 7,,. oc m Si fairly reproduces experimen- 
tal results for the temperature ratio Ti/T 2 measured in a gas of grains in a 
box vertically vibrated. It is also known that equipartition is not recovered 
even in the so-called tracer limit [?], i.e. in the case N 2 = 1 and JVi » 1. 
For binary mixtures we discuss recent results [?] obtained for both molecu- 
lar dynamics and DSMC. The above Fluctuation-Response experiment with 
a small perturbation introduced on a particle can be performed integrating 
in time, measuring the mobility of a tracer particle and comparing it with its 
self-diffusion coefficient: this is useful to reduce noise in the measurement of 
the response function. The mobility of the tracer particle can be measured 
by applying a small constant drag force f x , in the x direction for instance 
to a given particle, labeled 0, for times t > (we assume the system to be 
isotropic). The linearity of the response is always checked by changing the am- 
plitude of the perturbation. The perturbed particle will reach at large times a 
constant velocity jif x , related to the instantaneous response of Eq. (4.59) by 



The mean-square displacement averaged over many unperturbed dynamics 
B{t) = (|r (t) — r (0)| 2 ) asymptotically grows linearly in time, B{t) ~ ADt (in 
dimension d = 2) with a self-diffusion coefficient given by D = f£°{v (t)v (0)). 
Integrating the relation (4.61), one obtains a prediction for the mobility in the 
uncorrelated Gaussian case: 



where T s is the granular temperature of the species that the perturbed particle 
belongs to. 

The general result for a binary mixture [?] is analogous to the one for monodis- 
perse gases: even when the velocity pdf is non Gaussian, the closeness between 
correlations of different order makes relation (4.70) true. By using as test parti- 
cle a particle with index 1 (2) for species 1 (2), one obtains the two responses 
Xi = Xiit) -rci(O) ~ (^i)oo* and X2 = x 2 (t) - x 2 (0) ~ (Sv^^t, and thus 
the mobilities jii and fi 2 . Two independent Einstein relations (/ij = Di/Tj) 
are verified, by plotting Xi vs - 111 figure 10 we show, as an example, the 
verification of the validity of Green-Kubo relations using DSMC in spatially 
homogeneous regime. All the experiments, performed varying the restitution 
coefficients and the masses of the two components, and with different models 




(4.69) 




(4.70) 
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and algorithms (homogeneous and non-homogeneous, DSMC and MD) showed 
identical results, i.e the linearity of response-perturbation relation with effec- 
tive temperature equal to the granular temperature of the perturbed species. 
The same is true for other kinds of perturbation, such as the current-shear 
perturbation experiment discussed above. 

In figure 11 an even more striking result is portrayed: the mobility-diffusion 
parametric graph is shown in the case of a single tracer with different prop- 
erties with respect to a bulk gas (Aq = 500, N 2 — 1). In this case the tracer 
does not perturb significantly the bulk. However the temperature of the tracer 
is quite different from the bath temperature as well as from the gas temper- 
ature [?]. Again, the effective temperature of the tracer corresponds to its 
temperature and not to the temperature of the bath or of the bulk. That is 
to say that a non-perturbing thermometer, used to measure temperature of a 
granular gas through Fluctuation-Response relations, would measure its own 
temperature and not the bulk temperature. This is a consequence of the lack 
of thermalization, or equipartition, due to energy dissipating collisions which 
characterize stationary states of granular systems. 



Fig. 10. Binary mixture, homogeneous DSMC: mobility vs. mean-square displace- 
ment; left: an = 0.3, a±2 = 0.5, 022 = 0.7, 777,2 = 3mi, T\ k, 0.2, T2 « 0.38; right: 
an = «12 = «22 = 0.9, 7712 = 5mi, T\ k, 0.035, T2 f» 0.05. Symbols are numerical 
data, lines have slope l/(2Ti) and 1/(2T 2 ). 

Failure of the Einstein relation: correlated degrees of freedom 

The factorization of the invariant phase space measure, Eq. (4.60), is no more 
obvious in model (i) when density increases. Correlations between different 
degrees of freedom (d.o.f.), that is positions and velocities of the same or of 
different particles, appear also in homogeneously driven granular gases, as an 
effect of the inelastic collisions that act similarly to an attractive potential. 
Such a phenomenon has been discussed for this model of bath in [?,?,?,?] and 
for other homogeneous thermostats in [?,?,?]. In [?,?] it was also discussed 
the interplay between local density and local granular temperature, which in 
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Fig. 11. Binary mixture, homogeneous DSMC: mobility Vs. diffusion of a single 
particle of mass mtracer in contact with N = 500 particles of mass m, immersed 
in a heat bath (i.e. random kicks plus viscosity). We use the following conventions: 
(^tracer = ol\i and a = a\\. Only in case A) the tracer is also in contact with the 
external driving heat bath. A) mtracer = m, a = 0.9, atracer = 0.4, T g = 0.86, 
T tracer = Q7Q . B) = m> a = .9, a tracer = 0.4, T g = 0.86, Tf acer = 0.46; 

C) mtracer = 7m, a = atracer = 0.7, T g = 0.74, T» acer = 0.60; D) m tracer = 4m, 
a = atracer = 0.7, T g = 0.74, Tf acer = 0.57. The solid line has slope Tf acer , the 
dashed line has slope T g . 



some very dissipative cases present strong fluctuations correlated to each other. 
These correlations indicate a breakdown of the factorization of the invariant 
measure, in particular the velocity and the position distributions of a given 
particle do not factorize. In general, even when relation (4.60) does not hold, 
one can define (and compute) the marginal probability density function of the 
component x of the velocity of one particle i, as the marginalized of p({vj, Xj}): 

. N N 

p?w=/n^ n <fr**>M{v,x}). (4.71) 

k=l k=l,ky^i 

However not always does this function play a direct role in the response func- 
tion. For example, perturbing the x component of the velocity of the i-th 
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Fig. 12. Left: correlation functions and response. Right: velocity pdf. Both plots 
refer to the case of a dense granular gas 

particle and measuring the response of the same component, one obtains 

This is exactly what happens in model (i) (here we discuss only the monodis- 
perse case [?]) when density is increased. In Figure 12, left frame, the correla- 
tion functions C\{t) and C^t) are shown, together with the response function 
measured with different values of the perturbation 5v (0). The very good agree- 
ment between different response functions guarantees that the system is indeed 
linearly perturbed. At the same time, the different correlation functions C^it) 
are very close, reproducing the phenomenology already observed in the previ- 
ous dilute cases, with the difference that the time dependence is not exponen- 
tial but slower, closer to a stretched exponential ~ exp(— (t/r) a ) with a < 1. 
Finally, looking at the velocity pdf of the gas, the previously proposed expo- 
nential of a cubic expression, Eq. (4.62) with a negligible c 3 coefficient, is found 
to perfectly fit the numerical results. Therefore, if the correlations among the 
different d.o.f. are neglected, using equation (4.63) and the proportionality of 
the functions C n (t), a verification of the Einstein formula R(t) = C\{t) is still 
expected. The results displayed in Figure 12, left frame, demonstrate that this 
is not the case: the hypothesis of weak correlations among different d.o.f. is 
not appropriate and the correct response function is given by Eq. (4.72). 



R(t) = -U(t) 



dfiip({v,x}) 

dvf 
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Fig. 13. Ratio between response and auto-correlation for different densities and 
restitution coefficients 

The degree of violation of the Einstein formula increases with the volume 
fraction <j) and the inelasticity 1 — r, as shown in Figure 13, where the ratio 
R(t)/Ci(t) is reported as a function of time. This observation is consistent 
with the above argument: correlations among different d.o.f. increase when the 
probability of repeated contacts (the so-called "ring collisions") is enhanced, 
and this happens when the excluded volume is reduced as well as when the 
post-collisional relative velocity is reduced. 

A linear model with two correlated variables 

It is interesting to discuss a simple model with only two d.o.f. with Gaus- 
sian marginalized pdfs. The two variables, x, y, obey the following system of 
coupled Langevin equations: 



dx(t) 

dt 
dv(t) 

dt 



m u x(t) + m 12 v(t) + 011771 (i) + cr 12 r] 2 (t) 



m 2 ix(t) + m 22 v(t) + 02i77i (t) + a 22 r) 2 (t) 



(4.74) 



(4.73) 
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When the matrices rh and <x are diagonal, the two variables are independent. 
Otherwise, they are correlated. Provided that the matrix rh is negative definite 
and det a 7^ 0, the pdf of the two variables relaxes toward an invariant joint 
pdf, given by a bivariate Gaussian function. Instead of discussing the general 
case, we suppose that the invariant joint pdf is expressed by 

x 2 iP" XV 

p(x, v) oc exp(-y - — + —). (4.75) 



The marginal pdf of each variable is then a Gaussian. Neglecting the corre- 
lation among x and v, the response of v to a perturbation, would again be 
expected to be equal to C\{t) = (v (t)v (0)) / (v 2 ). On the contrary, the correct 
response is given through the full formula (3.9), applied to the joint pdf (4.75). 
The result is 

R(t) = (v(t)v(0))-±{v(t)x(0))- (4-76) 

The difference between the Einstein formula and the correct response is shown 
in Figure 14 for one choice of the matrix rh. 



The role of spatial inhomogeneity 

Inspired by a work about violations of the Einstein relation in a non equilib- 
rium model [?], it is natural to conjecture an effective spatial dependence of 
the pdf of the velocity component for a particle at position x, at time t of the 
form 

P ^M)~exp p- 2 y )|2 }, (4.77) 

where w(x, t) is a local velocity average, defined on a small cell of diameter L\, ox 
centered in the particle. Such a hypothesis is motivated by the fact that, at 
high density or inelasticities, spatially structured velocity fluctuations appear 
in the system for some time, even in the presence of external noise [?,?]. 
Following relation (3.9), with the ansatz (4.77), a formula for the response 
function follows: 

R(t) = C S = ±-(v(t){v(0) - «[x(0)]}>. (4.78) 
1 9 

Figure 15 shows that relation (4.78) is fairly verified. Note however that the 
proposed form (4.77) cannot be completely exact, a spatial dependence of T g 
should also be included. 
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Fig. 14. Response R(t) and velocity correlation C±(t) in the simple Langevin model 
with correlated variables discussed in Eq. (4.73), with parameters m\\ = —1.1, 

771,12 = "721 = 0.8, 77722 = ~ 1- 

4-4 Further applications 
4-4-1 Nano- systems 

Since the early 60's, technology follows a trend towards miniaturization, which 
has led to the construction of devices of the size of a few tens of nanometres, 
or smaller. In some circumstances, these devices are built by assembling single 
molecule after single molecule. While technology at the fim scale is known to be 
more sophisticated, but not substantially different from the macroscopic world 
technology, it is universally believed that nanotechnology has to face physical 
features which are quite different from those of the macroscopic world, espe- 
cially when it comes to devices whose parts are made of an order 0(1) up to 
O(10 3 ) atoms or molecules. In itself, this does not look particularly surprising. 
Indeed, macroscopic bodies owe their properties to the very large number of 
their microscopic constituents, and to the fact that these constituents interact 
with each other, in very precise fashions. This allows the onset of the state of 
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Fig. 15. Response R(t) and different correlation functions for the same MD sim- 
ulation discussed in Figure 12. The normalized velocity self-correlations C\(t), as 
well as the correlation C s (t) defined in Eq. (4.78), for different values of the coarse 
graining radius Lt, ox are reported. 

local thermodynamic equilbrium (when the driving forces are not too large) 
and of its consequences, like the validity of the hydrodynamic laws. The fact 
that the microscopic constituents of small systems, like nano-devices, obey the 
same dynamical laws as those of the constituents of a macroscopic body is not 
sufficient for the small systems to behave as macroscopic objects. Landau and 
Lifshitz express this concept as follows [?]: 

"At first sight, one may conclude that the growth of the number of particles 
makes infinitely complicated and intricate the properties of the mechanical sys- 
tem at hand, so much that it becomes impossible to discover any guiding law 
in the behaviour of the resulting macroscopic body. But this is not the case 
and, as we will see below, new and very special laws emerge for a very large 
number of particles. 

These are the so-called statistical laws which are due precisely to the exceed- 
ingly large number of particles of which the body is made. These laws are in 
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no way reducible to mechanical laws, their specific characteristic is that they 
make no sense for mechanical systems of a small number of degrees of freedom. 
Therefore, the presence of many degrees of freedom implies substantially dif- 
ferent laws, even though the motion of a system with many degress of freedom 
follows the same mechanical laws of a system of a few degress of freedom. " 

In particular, the hydrodynamic laws exclude that macroscopic observables 
may spontaneously fluctuate: this is considered possible, but practically irrel- 
evant, in many-particles systems. Differently, fluctuations are not negligible in 
small systems or in small parts of macroscopic systems, where they might be 
directly observable [?,?]. 

Nanotechnological devices are then expected to behave differently from ther- 
modynamic systems. Among them, we find, for instance, quantum dots, carbon 
nanotubes and molecular machines, whose sizes range from a few to 0(100) 
nanometres. The question is: which are the laws that describe the behaviour 
of such small systems? This question is particularly important not only for 
its nanotechnological implications, see e.g. Ref. [?], but also for understand- 
ing from a fundamental point of view the behaviour of microscpic systems in 
general and, in particular, biological systems. Indeed, bacteria and cells are 
quite larger than the few tens of nm which qualify nanonsystems, but their be- 
haviour is determined by events that occur at the nanoscale, like the transport 
of matter through the cell's membrane. 

At the moment there is no clear answer to the above question. However, a 
widely shared view is that the mechanical laws, which are overshadowed by 
the statistical laws in macroscopic systems, should play an important role 
in nanosystems, hence it appears promising to explore the nanoworld from a 
dynamical systems point of view. In particular, the fluctuation relations which 
are the object of Section 5 are expected to be applicable to nano-phenomena. 
Indeed they have been tested and verified to various extents [?,?], as discussed 
in Section 5. The study of granular systems, in turn, may provide insights on 
the above questions, since they would be mesoscopic objects, were their grains 
of the size of atoms or molecules. 



4-4-2 Fluctuations and response in biological systems 

Some applications of linear response theory to biological systems have been 
recently discussed by Kaneko and co-workers [?,?]. The idea is that fluctu- 
ations, always present in living organisms, are relevant for the response of 
average properties to changes in the environment. Environmental conditions 
can be seen as parameters determining the distribution of fluctuations of mea- 
surable quantities: for example, the concentration of a protein in a cell, as well 
as its fluctuations, are influenced by many parameters, such as temperature, 
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pH value and so on. When an external perturbation is switched on, the pa- 
rameters change and the distributions of biological variables respond in some 
way. A general relation for this response can be derived: in the following, for 
simplicity but without loss of generality, we assume that the distribution of 
fluctuations can be approximated by a Gaussian, and we discuss the case of a 
scalar external parameter a and a unique scalar observable x. Upon a change 
Aa of the parameter, the distribution of x changes from p a (x) to p a +Aa{x), 
which can be written as 

p a+ Aa(x) = Pa (x) e^-W*)-!^) = Pa ( x ) e ^ Aa ^ . (4.79) 

The Gaussian assumption allows us to neglect the powers of x higher than x 2 
in the expansion of e(a,Aa,x) = In p a+ & a (x) — hiPa(^), obtaining 

Pa+Aa(x) = p a ( x ) N e e (1 HaAa)(x-(x) a )+±eVHa,Aa)(x-(x) a )^ (4g0) 

where = (<9 n e(a, Aa, x)/dx n )\ x= { x ) a and iV = e e<0) . Using this formula to 
calculate (x) a +Aa, the average of x in the perturbed system, one obtains: 

(x} a+A a -(x) a = («, Aa)^ ~ b(a)a 2 a Aa (4.81) 

where the first order in the parameter change has been considered, introducing 
6(a) = de^(a,Aa)/dAa\A a =o, and o 2 a = ((x — (x) a ) 2 ). Equation (4.81) is a 
particular case of FDR, and in fact can be derived from the generalized rela- 
tion (3.9): it does not require thermal equilibrium, but only the quasi-Gaussian 
assumption on p(x). It must be noted, however, that in relation (4.81) the co- 
efficient 6(a) can in principle be related to a 2 . 

An experimental proof of relation (4.81) has been obtained studying the phe- 
notype response to the exertion of an artificial selection pressure over the 
genotype of a population of E. Coli bacteria. The fluorescence intensity of the 
Green Fluorescent Protein (GFP) has been used as a marker of the pheno- 
type state x. The external force has been identified as the selection pressure, 
providing a constant rate of variation of the genotype, taken as the parame- 
ter a. The distribution of fluctuations of the fluorescence intensity p a {x) has 
been measured in successive generations during the application of the exter- 
nal force. To apply the above relation, the DNA sequence of genes in the cell 
is regarded as a parameter influencing the variables of the cell system, i.e. 
the phenotype. The measured distribution p a (x) provides the average (x) a as 
well as its variance a 2 . The proposed relation (4.81), with a coefficient 6 not 
dependent on a, has been validated by these experimental data. 

The above experiment probes the relevance of phenotype fluctuations among 
clones, i.e. organisms with identical genes: these fluctuations are always pos- 
sible because living cells are of finite size and at finite temperature. In nature, 
however, genetic diversity is the norm: the parameter a is not single valued 
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in a population, but is distributed around a mean. The variance of phenotype 
fluctuations is then also induced by genotype variability. It is this variance 
that was considered by Sir Ronald Fisher in his celebrated fundamental the- 
orem of natural selection [?], which asserts that evolution speed and genetic 
variance are proportional. Even if the phenotipic variance of the clones, Vi P , 
is not equivalent to that of phenotypes in a genetically diverse population, 
V g , they have been shown to be related in [?]. There, an inequality has been 
derived, stating that 

V g < V ip , (4.82) 

only assuming that the phenotype distribution is single-peaked and not too 
broad, which is equivalent to require a robustness of the mean phenotype to 
genotype fluctuations. The equality sign in Eq. (4.82) holds in the limit of high 
evolution speed, just before the appearance of the error catastrophe, where the 
phenotype distribution becomes too broad and the single-peak assumption 
fails. 

Concluding, we can say that Fisher's theorem is somehow a biological version 
of a general form of FDR. Let us stress the formal analogy with statistical 
mechanics, whose small fluctuations of macroscopic variables can actually be 
detected from the response functions. Analogously, in biology the fluctations of 
the genotype variables, which are the corresponding " microscopic" quantities, 
can be understood from the phenotype features. 



5 Fluctuation relations 



While the theory of fluctuations around equilibrium states can be considered 
quite satisfactory and complete, the same cannot be said of the nonequilibrium 
theory. In this context, the 1993 paper by Evans et al. [?], on the fluctuations of 
the entropy production rate, has been a pioneering attempt towards a unified 
theory of a wide range of nonequilbrium phenomena [?]. The relation proposed 
and tested in [?] is nowadays merely called Fluctuation Relation (FR). It 
constitutes one of the few general exact results, obtained on purely dynamical 
grounds, for systems almost arbitrarily far from equilibrium, and close to 
equilibrium it is consistent with the Green-Kubo and Onsager relations. A 
considerable number of works have been devoted to it, and various authors 
have derived it in different ways (e.g. [?,?,?,?]). 



The FR of Ref.[?] reads 



Prob r (A) _ eTA 



Prob r (-A) 

where A and —A are averages of the normalized power dissipated in a driven 
system, in a long time r, and Prob T (±A) is the steady state probability of 
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observing values close to ±A The relation was derived for the following isoen- 
ergetic model of a 2-dimensional shearing fluid: 



d Pi 

"77 Qi = — + 7 Vi* 

at m 



(5.2) 



where T = (qi, Pi, qjv, Pn) represents one point in phase space, 7 is the 
shear rate in the y direction, x is the unit vector in the x-direction, and the 
friction term a t h (also called "thermostat") takes the form 

N 

* th (T) = --^L- 2 5>h^ (5.3) 

l^i=\ Pi i=i 

determined by Gauss' principle of least constraint (cf. Subsection 5.3). In this 
popular molecular dynamics model, the phase space contraction rate, defined 
by 

k i dq\ dp] 

is proportional to the "thermostat" a t h, hence to a quantity Q, which is the ir- 
reversible entropy production, or the energy dissipation rate, divided by X) pf • 

Evans and Searles focussed on the fluctuation properties of VI [?,?,?,?,?,?], 
which differs from A in most cases. They obtained "transient" FRs, which 
hold under the sole condition of reversibility of the microscopic dynamics. 
The term transient means that such relations concern the statistics of evolv- 
ing ensembles of trajectories, rather than that of the steady states. These au- 
thors argued that, in the long r limit, the same relations describe the steady 
state fluctuations. We call f2-FR's these relations, which will be described in 
subsection 5.3.2. 



Gallavotti and Cohen provided the mathematical setting for the results of 
Ref.[?], introducing the Chaotic Hypothesis [?,?,?]: 



Chaotic Hypothesis: A reversible many-particle system in a stationary state 
can be regarded as a transitive Anosov system (cf. Appendix C) for the purpose 
of computing its macroscopic properties. 



The result is a steady state FR for the fluctuations of A, which we call A- 
FR, and we describe in subsection 5.3.1. Such a strong assumption as the 
Chaotic Hypothesis raised the question of which models of physical inter- 
est are "Anosov-like" , since almost none of them is actually Anosov (lack of 
uniform hyperbolicity being usual). The idea was that the Anosov property, 
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analogously to the Ergodic property, could hold "in practice". This view faces 
some difficulties which are evidenced and tackled, for example, in Refs. [?,?]. 

Other relations which concern the statistics of nonequilibrium systems, and 
have generated much interest, are the Jarzynski and Crooks relations; they 
belong to the class of transient FRs, and relate free energy differences between 
equilibrium states to non-equilibrium processes [?] , as described in subsection 



The derivation of the FR's for determinisitc systems motivated stochastic 
approaches, beginning with Kurchan's work [?]. Among these studies, Ref.[?] 
has to be singled out since it solved, in a special difficulty of systems 

with infinite state spaces, which are quite common. The works by Bodineau 
and Derrida [?], and by Jona-Lasinio and coworkers [?] also treat fluctuations 
in stochastic systems, but develop different theories, hence will be discussed 
separately in Section 6. 

We do not attempt an exhaustive review of this subject: we focus mainly on the 
papers which initiated the various research lines. Because entropy production 
is one of the quantities which are most investigated in this context, we begin 
recalling basic facts of Irreversible Thermodynamics. After that, we describe 
the models in which the FRs were first considered. 



5. 1 Irreversible entropy production 

The main object of the FR's is the irreversible entropy production, for systems 
in Local Thermodynamic Equilibrium (LTE), or the energy dissipation rate, 
more in general. 

Irreversible Thermodynamics can be applied to systems that satisfy LTE [?]. 
Physically, LTE is due to the local exchange of momentum and energy in many 
particle collisions, leading to a local Maxwell velocity distribution and local 
thermodynamics. This allows one to assume that the specific (i.e., per unit 
mass) local entropy s at a position r = (ri,r 2 ,r 3 ) at time t is a function of 
the local specific energy u, of the local mass density n, and of the local mass 
fractions c = {q}| =1 of the k constituents out of which the system consists, 
as it is in equilibrium. In other words, LTE implies 



5.3.3. 



s(r,t) = s[u(r,t),n(r,t),c(r,t)] , 



(5.5) 



and 



k 

Tds = du + pdv — Hidci 
i=i 



(5.6) 
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where p is the pressure, v = 1/n is the specific volume 11 , and //j the chemical 
potential of component %. In particular, LTE assumes that Eq.(5.6) remains 
valid for a mass element followed along its center of mass motion, even if the 
total system is not in equilibrium, so that one can write: 

k 

TD t s = D t u + pD t v - Vi D tCi (5.7) 

i=i 

where, denoting with v(x, t) the macroscopic velocity, 

D t = dt + v-V T 

is the (barycentric) substantial time derivative [?] . It turns out that LTE holds 
for a wide variety of transport phenomena. 

The hydrodynamical equations are based on LTE, as well as on the local 
conservation laws for u, v and the q's. Assuming local linear laws for their 
fluxes, one obtains, for instance, Fick's law for tracer diffusion, with local flux 
J: 

J(r,t) — —D V r n(r,t) (5.8) 

where V r n is the local density gradient, and D the diffusion coeffficient. 12 
For viscosity, the local flux is given by Newton's law, and is expressed by 

du ■ 

^M) = -^M) (5.9) 

where Jjj is the r/'-component of the local pressure tensor, giving the flow of 
the j-component of the local momentum of a fluid in the redirection, sheared 
by a linear local velocity gradient duj/dri, and 77 is the viscosity coefficient. 
Similarly, one obtains all the other linear laws of Irreversible Thermodynamics. 
It is worth pointing out that states described by nonlinear laws, for the local 
quantities mentioned here, may be necessary in the presence of strong external 
forces and gradients, but this does not mean that LTE is broken: as long as 
one can properly speak of local thermodynamic quantities, LTE must hold. 

Equation (5.7) and the hydrodynamic equations lead then to the entropy 
balance equation for the local variation of the entropy density: 

n(r, t)D t s(r, t) = - div J s (r, t) + a s (r, t) , (5.10) 

where J s is the local entropy flux, and a s > is the local irreversible entropy 
production. This is a quantity related to the dissipated energy, hence should 
not be confused for the mere entropy variation, which takes place even in dissi- 
pationless phenomena, and does not need LTE. Indeed, in the linear regime, a s 

11 In other words, v is the volume per unit mass. 

12 More in general, D may be a tensor. 
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is usually written as Y^iXiJi, where X« and J« are conjugate thermodynamic 
forces and fluxes, respectively. 



5.2 Ergodic hypothesis: the Khinchin's approach 

As in the study of equilibrium phenomena, it is desirable to develop a mi- 
croscopic interpretation of the macroscopic theory outlined above, in order 
to extend our understanding beyond the realm of the previous subsection. To 
connect the theory of irreversible thermodynamics with a microscopic descrip- 
tion, in analogy with equilibrium statistical mechanics, models are needed to 
assess the various hypothesis and to derive relations of practical interest. In- 
deed, while the equilibrium theory is solidly based on the Gibbs ensembles 
and on the Ergodic Hypothesis, the nonequilibrium counterparts of these en- 
sembles and hypotheses are not identified yet, although various proposals have 
been made in the literature. Before we continue, it is therefore useful to re- 
call how the microscopic description of equilibrium phenomena is based on 
the Ergodic Hypothesis, following Khinchin's approach [?]. This will suggest 
possible avenues of investigation, for the case of nonequilibrium phenomena. 

Khinchin looked at the ergodic problem from a physical perspective, avoiding 
the physically scarcely relevant concept of metrical transitivity, implied by the 
Birkhoff theorem. His general idea stems from the following facts: 

a) statistical mechanics concerns systems with a large number of degrees of 
freedom; 

b) the physical observables are not generic (in mathematical sense) functions; 

c) it is physically acceptable that ensemble averages do not coincide with time 
averages, for sets of initial conditions V of measure tending to zero when 
N -> oo. 

Kinchin considers systems with a separable Hamiltonian, i.e. systems whose 
Hamiltonian can be written as 

N 

H = ^# n (q n ,p„) 

71=1 

and a special class of observables (called sum functions) of the form 

N 

/(r) = E /„(<!»» p») 

n=l 

where f n = 0(1). The pressure, the kinetic energy and the single-particle 
distribution function are examples of sum functions. 
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Denote by ( ) the microcanonical ensemble average, and let f(T) be the time 
average of the observable /, along a trajectory starting at T. Under quite 
general hypotheses, and without invoking any metrical transitivity, Khinchin 
showed that the following holds: 

Prob ( ^yp > ^iiV~ 1/4 ) < K 2 N~ l " 

where K\ and K 2 are 0(1). This means that ensemble averages of sum func- 
tions differ more than a given tolerance from time averages, only along trajec- 
tories whose initial conditions have vanishing measure in the N — > oo limit. 
Mazur and van der Linden [?] extended this result to systems of particles 
interacting through short range potentials. 

This shows that the details of the phase space dynamics (i.e. of the microscopic 
dynamics) are practically irrelevant for a notion of ergodicity that describes 
physical systems and, indeed, they must be irrelevant for the thermodynamic 
behaviour to be as common as it is. In Khinchin's theory, the good statistical 
properties that are required are mainly explained as consequences of the fact 
that iV is very large. 



5.3 Molecular dynamics models 



The models developed in nonequilibrium molecular dynamics (NEMD) have 
been adopted, in the development of microscopic theories of irreversible ther- 
modynamics, because they are sufficiently simple to be analyzed in detail, and 
because of their success in describing various properties of nonequilibrium flu- 
ids and solids [?,?]. It is known that results produced by simulations of these 
systems are not reliable if quantum mechanical effects are important, if the 
interatomic forces are too complicated or insufficiently known, if the number 
of particles needs to be too large, or the simulations time too long. But NEMD 
models are otherwise appropriate in computing quantities such as transport 
coefficients, and are a valid alternative to experiments. Furthermore, the FRs 
were first conceived and investigated in one such model. The range of proper- 
ties of a given physical system which they can describe, however, is not clearly 
delineated, and care should be used if the property under investigation is di- 
rectly affected by the fictitious forces which characterize NEMD. The simplest 
NEMD models are derived from Gauss' principle of least constraint [?,?]: 

Gauss Principle (1829): Consider N point particles of mass mi, ...,mjv, 
subjected to frictionless bilateral constraints Cj and to external forces Fj. 
Among all motions allowed by the constraints, the natural one minimizes 
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the "curvature" , defined by 

N / F \2 N i 



In the case of holonomic constraints, the equations of motion are Hamiltonian 
while non-holonomic constraints lead to non-Hamiltonian equations. The isoki- 
netic (IK) constraint, which fixes the kinetic energy K = X^P? /2m, and the 
isoenergetic (IE) constraint, which fixes the internal energy Hq = K + $ m * ; 
$ m * being the interaction potential, yield: 

Pi 

m 

i = l,...,7V (5.11) 

Fr'(q) + Fr'(q)-^(r) Pl 

where F* nt (q) and F^*(q) respectively denote the interactions among the par- 
ticles and the external force driving the system. In particular, for F^'(q) = 
QF e , where q is a charge coupling particle i to the external field F e , and 

J = ££iCi(dqiM), 



r d 



Mr) = a JJir (r) = ^ ( J • F e + E ^ • F r') preserves K , (5.12) 
a th (Y) = a IE {T) = ^—J ■ F e preserves H . (5.13) 

In the case of the SLLOD model, defined by Eqs.(5.2), one has: 

1 N N 

(5.14) 

In the above examples, olje is the energy dissipation rate divided by the ki- 
netic energy which, in local equilibrium, becomes the entropy production rate. 
Because A = — div (dT/dt) is in turn proportional to ajE, A can be identified 
with the entropy production rate. However, real systems in nonequilibrium 
steady states can hardly be isoenergetic, and this identification appears to be 
accidental and of too limited validity. 

Depending on the physical property to be described, other constraints can 
be used; e.g. isobaric, isochoric, isoenthalpic, constant stress constraints. The 
deterministic term — a^p is meant to add or remove energy from the system, 
to balance the action of the driving forces, so that a steady state can be 
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reached [?] 13 . This constraint has no immediate physical meaning; it merely 
serves the purpose of replacing the many (practically impossible to treat) 
degrees of freedom of a real thermostat, without appreciably perturbing the 
properties of interest of the system under investigation. For quantities not 
affected by how energy is removed from the system, its form is irrelevant 
and various mechanical constraints will do [?,?,?]. The introduction of one or 
another such constraint in the equations of motion is analogous to the choice of 
one numerical algorithm or another, for the solution of a given mathematical 
problem: one must choose the constraint or the algorithm which alters as little 
as possible the quantity to be computed. The introduction of hyperviscosities 
in the modellization of turbulence is another analogous procedure. 

Constant internal energy Hq or constant kinetic energy K, which prevent the 
system from indefinitely "heating up" , are popular constraints. The resulting 
systems are not Hamiltonian, but a Hamiltonian structure is not to be ex- 
pected in systems in nonequilibrium steady states, if the thermostat degrees 
of freedom are not included [?]. Indeed, a complete iV-particle model of a sys- 
tem and of its thermostat consists of Hamiltonian equations, which may be 
written as: 

/ 



d_ T= d_ 

dt dt 



r « =G (D= G ' r " r "| , (5.15) 
y Tr J y G r (T s , T T 

where T s = {qi,Pi}, i = 1,...,N S , T r = {q;,Pi}, i = N s + 1,...,N, and the 
subscript s refers to the N s particles of the thermostatted system, while the 
subscript r refers to the N r = N — N s particles of the reservoir. Moreover, 
if the time reversed evolution is allowed in phase space, it is also allowed in 
the projected space. As the reservoirs remove energy from a driven system, 
on average, the projected dynamics must be dissipative. 14 Something similar 
happens in NEMD models, hence their non-Hamiltonian nature is not a hin- 
drance, by itself. However, NEMD models are not obtained through the ideal 
projection procedure, and have been developed for specific practical purposes. 
Therefore, they must be used with care [?,?]. 

Another popular deterministic model is the Nose-Hoover thermostat [?], de- 
fined by: 

where K Q is the chosen average of the kinetic energy K(p), and 9 is a relaxation 
time. Normally, particles interact, the dissipation is not too high and the 



13 This form of deterministic "thermostat" is computationally efficient, and makes 
the equations of motion time reversal invariant [?]. 

14 Systems of non-interacting particles behave differently: usually projection leaves 
the dynamics Hamiltonian. 
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dynamics are sufficiently ergodic that the initial value of £ does not matter. 
In the small 9 limit, Nose- Hoover approximates Gaussian IK dynamics, but 
is more realistic and, in equilibrium, it generates canonical distributions as 
appropriate for macroscopic isothermal systems. 

The models illustrated above, like many others developed in NEMD, contain 
artificial forces, which are not present in Nature. The fact that they accurately 
describe certain properties of real systems, nonetheless, suggests that a form 
of equivalence of ensembles may be envisaged in nonequilibrium statistical 
mechanics. Several works have been devoted to clarify this issue. The first 
of them, as far as we know, are due to Evans and Morriss [?,?]. For the 
equivalence of various thermostatted responses, see Refs. [?,?,?,?,?], while [?,?] 
show that the phase space dimensionality loss, due to dissipation, is a bulk 
phenomenon even when the thermostat acts only on the boundaries [?]. Other 
aspects of the equivalence of deterministic thermostats are discussed in [?,?]. 
In practice, one finds that response to external drivings is not too sensitive 
to the choice of the thermostatting mechanisms and that, in some cases, the 
equivalence of behaviors reaches rather subtle dynamical properties [?,?,?]. 

5.4 Deterministic systems: transient and steady state relations 

In this Section, we discuss three sets of fluctuation relations, part of which 
concerns steady states, while the others describe properties of transient states 
arbitrarily far form equilibrium. The Gallavotti-Cohen and the steady state 
Evans-Searles approaches lead to steady state relations. The transient Evans- 
Searles, the Jarzynski and the Crooks approaches lead to transient relations. 

5.4-1 The Gallavotti-Cohen approach 

The idea proposed by Gallavotti and Cohen [?], is that dissipative, reversible, 
transitive Anosov maps (cf. Appendix C) are idealizations of nonequilibrium 
particle systems, hence that properties like the A-FR are enjoyed by physical 
systems as well. That the system evolves with discrete or continuous time, 
was thought to be a side issue in [?], as apparently confirmed by Gentile's 
derivation for continuos time [?] . The proof of the A-FR for such maps followed 
these steps. First of all, it is known [?] that one Anosov map S 15 admits a 
special kind of partition of its phase space A4, which is called Markovian. 
This is a subdivision of M. in cells whose interiors are disjoint from each 
other, and whose boundaries are invariant sets constructed using the stable 
and unstable manifolds. Consequently, the interior of a cell is mapped by S in 

15 We denote by S k X the evolution that S implies from the initial condition X(0) = 
X, i.e. X(l) = SX, X{2) = S 2 X, etc. 
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the interior of other cells, and not across two cells, which would include a piece 
of their boundary. Furthermore, arbitrarily fine partitions can be constructed, 
exploiting the time reversibility of the dynamics. Gallavotti and Cohen further 
assume that the dynamics is transitive, i.e. that a typical trajectory explores 
all regions of A4, as finely as one wishes. It is this structure that guarantees 
that probability weights of the kind conjectured in [?], cf. Eq.(C.3), from which 
the A-FR follows, can be assigned to the cells of a finite Markov partition. 

More precisely, let A(X) = — log J(X), where J is the Jacobian determinant 
of S, 16 and consider the probability (or frequency of observation along one 
steady state trajectory) of the dimensionless phase space contraction rate, 
obtained along a trajectory segment Wx, T , of origin X e M. and duration r. 
This quantity is defined by 

e T (X) = -L A(S k X) (5.17) 

> ' k= — r/2 

where (.) is the phase space average, with respect to the steady state proba- 
bility distribution. Let J u be the Jacobian determinant of S restricted to the 
unstable manifold V + , i.e. the product of the asymptotic factors of separation 
of nearby points, along the directions in which distances asymptotically grow 
at an exponential rate. If the system is Anosov, the probability that e T (X) 
falls in B pt = {p — e,p + e) coincides, in the limit of fine Markov partitions 
and long r's, with the sum of the weights 

of the cells containing the points X such that e T (X) e B P:6 . Then, if Tr T (B Pje ) 
is the corresponding probability, one can write 

7r T (e T (X) E B PtC ) « \- ]T w XiT (5.19) 

where M is a normalization constant. If the support of the physical measure 
is Ai, which is the case if the dissipation is not exceedingly high [?], time 
reversibility guarantees that the support of ix T is an interval [— p*,p*], p* > 0, 
and one can consider the ratio 



■K T (B_ p>e ) Ex,e T (X)GB- P , £ W X,r ' 



(5.20) 



16 If the point X has d coordinates, Xi, i = 1, we can write Xi(k + 1) = 
fi(X(k)), where fi is a suitable function determined by S. Then J(X) is the absolute 
value of the determinant of the matrix {dfi/dXj) x . 
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where each X in the numerator has a counterpart in the denominator. Denot- 
ing by / the involution which replaces the initial condition of one trajectory 
with the initial condition of the reversed trajectory, time reversibility 17 yields: 

ApT) = -A(IX) , wix,t = w x \ and = exp(r(A)p) (5.21) 

Wix,t 

if e T (X) = p. Taking small e in B pe , the division of each term in the numerator 
of (5.20) by its counterpart in the denominator approximately equals e T ^ p , 
which then equals the ratio in (5.20). In the limit of small e, infinitely fine 
Markov partition and large r one obtains: 



Theorem (Gallavotti-Cohen). Let (Ai,S) be dissipative (i.e. (A) > 0), re- 
versible and assume that the Chaotic Hypothesis holds. Then, 



e T{A)p . (5.22) 



with an error in the argument of the exponential which can be estimated to be 
p, t independent. 



If the A-FR (hence the Chaotic Hypothesis on which it is based) holds, the 
function C(p; r, e) = (l/r(A)) log [n T (B p>€ ) /-k t (B_ p>€ )\, tends to a straight line 
of slope 1 for growing r, apart from small errors. If A can be identified with a 
physical observable, the A-FR is a statement on the physics of nonequilibrium 
systems. 

Under the assumption that A coincides with the entropy production rate, 
the A-FR can be used to obtain the Green-Kubo relations and the Onsager 
reciprocal relations, in the limit of small external drivings [?]. This way, the 
A-FR appears to be an extension of such relations to nonequilibrium systems. 
Gallavotti assumes that the (Gaussian isokinetic, continuous time) system is 
driven by the I fields F = (F 1: F 2 , F t ), that the phase space contraction 
rate vanishes when all drivings vanish, and that 

A(X) = ^F l J°(X) + 0(F 2 ). (5.23) 
i=i 

This relation defines the linear "currents" J 4 °, which are proportional to the 
forces Fj. Then, the fast decay of the A- autocorrelation function, leads to this 



17 Time reversibility means: IS n = S n I, where I 2 =Identity. For instance, / is the 
reversal of momenta for Eqs.(5.11), but is more complicated for the shearing system 
of Ref.[?]. 
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expansion for the large deviation functional 



C(p) = - lim - \ogn T (p) = i-L(p - If + 0((p - 1) 3 F 3 ) (5.24) 

where 



/oo 
(A(^X)A(X)) C eft 
-oo 



and (.)c denotes the cumulant. Thus, the A-FR, Eq.(5.22), leads to (A) = 
C2/2 + 0(F 3 ). Now, let the full (nonlinear) "currents" be defined by Ji(X) = 
8fX(X), and the transport coefficients be L i3 = Of^ (Ji) \f=o- The derivatives 
with respect to the parameters F require a property of differentiability of SRB 
measures, which has been proven by Ruelle [?]. Assuming this property, the 
validity of the A-FR and time reversibility, one can write 

< A > = \ E + d F AJ 3 ))\ F =oF t F 3 = l - £ {U 3 + L 3l )F t F 3 (5.25) 

i,j=l i,j=l 

to second order in the forces. Then, equating this with C2/2 and considering 
(Lij + Lji)/2 with % = j, one recovers the Green-Kubo relations. To obtain 
the symmetry L i3 = L 3i) Gallavotti extends the A-FR to consider the joint 
distribution of A and its derivatives. He introduces the dimensionless current 
q, averaged over a long time r, through the relation 

- / T/2 Fjdp.Ai^dt = F J (d F A)q(X) (5.26) 

T J—t/2 

and considers the joint distribution 7r T {p,q), with corresponding large devia- 
tion functional ((p, q) = — lim^oo - log7T r (p, q). The result is a relation similar 
to the A-FR: 

hm ... log — -. r = 1 . (5-27) 

Ap 7Tr(-P, -q) 



This makes the difference (((p, q) — (,(.~Vi ~<l)) independent of q, which leads 
to the desired result, L i3 = L 3i , in the limit of small F. This work was refined 
in [?]; for related results, based on orbital measures, see Refs. [?,?]. 

Assuming that the currents and transport coefficients, here defined in terms 
of the phase space contraction rate, do represent physical quantities, these 
results show that the FRs are consistent with Irreversible Thermodynamics, 
close to equilibrium. Hence they may be considered in the construction of 
a comprehensive nonequilibrium theory. However, some difficulties affect the 
present approach; the first being that A, which is directly related to the ther- 
mostatting term a t h, only in very special cases results proportional to the 
energy dissipation rate divided by the kinetic energy, Q. 

Because global fluctuations are not observable in macroscopic systems, local 
fluctuation relations have been devised, see e.g. Refs. [?,?,?], and in [?] also a 
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local version the A-FR was tested numerically. In particular, the local A-FR 
of Ref. [?] concerns an infinite chain of weakly interacting chaotic maps. Let Vo 
be a finite region of the chain centered at the origin, T > be a time interval, 
and define 

i To-l i To/2 

Vo.To-oc |V |i j=Q {A)\V\ j= _ To/2 

where V = V x T , A Vo (X) is the contribution to A given by V , and \E\ 
denotes the volume of the set E. Then, one obtains: 

n v (p) = e C(P)|v|+o(|av|) ^ with C MjzAt^ = 1 and | p | < p * , (5.29) 

where \dV\ is the size of the boundary of V, p* > 1 and £ is analytic in p. 
The contribution of the boundary term \dV\ should decrease with growing V, 
leading to the A-FR in the limit of large (compared to microscopic scales) 
volume Vo and long times T. 

The problem of local fluctuations, naturally leads to the possibility of extend- 
ing Onsager-Machlup theory to nonequilibrium systems. This has been done 
by Gallavotti [?,?], under the assumption that the entropy production rate is 
proportional to A. 

The fact that A ^ H in general, and the identification of the systems of 
physical interest which verify the Chaotic Hypothesis, hence the A-FR, pose 
an interesting question. For instance, Ref.[?] assumed that the A-FR could 
apply to systems which have singular A, since the A-FR had been proposed 
and verified in one such system [?] . Later, however, the steady state A-FR was 
found to be hard, if not impossible, to verify in non-isoenergetic systems with 
singular A, close to equilibrium [?,?,?]. In [?] various scenarios are proposed 
to explain these facts. One of them concerns Gaussian isokinetic systems, 
whose A is the sum of a dissipative term and a conservative term, and may 
be singular because of the interaction potentials (cf. Eqs.(5.12,5.14)). In that 
case, the dissipative term Q obeys the FR, while the conservative term does 
not, but its averages over long time intervals should become negligible with 
respect to the averages of Q as the length of the intervals grow [?,?]. Thus, 
in the long time limit, the A-FR should hold as a consequence of the validity 
of the fi-FR, while the convergence times of the A-FR would diverge when 
equilibrium is approached, because Q vanishes as the square of the driving 
forces. Moreover, for reasons of symmetry, the range [— p*,p*] of validity of 
the A-FR must shrink to {0} when the driving fields vanish, so that the A-FR 
may hold but only for trivial fluctuations. 

Trying to understand these facts, Refs. [?,?,?] concluded that in some cases A 
describes heat fluxes, not entropy productions, hence that in those cases the 
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A-FR has to be modified, to mimic the heat FR of Van Zon and Cohen for 
stochastic systems [?]. In particular, Ref.[?] considers systems of the following 
form 

|q, = P, j fPt = E - - a Pl A = A<°>-/?^V (5.30) 

where V is related to the interaction potential, 18 assuming that they have an 
equilibrium (E = 0) distribution with exponentially decaying tails, while A^ 
has Gaussian tails. It is then assumed that the tails have the same properties 
when E ^ 0. Then, the average of A in a time r takes the form 

A 0iT (X) = - f A(S"X)dt = A(V(X) + ^ [V(S T X) - V{X)\ . (5.31) 

T JO T 

For chaotic systems, and large r, it is now reasonable to assume that A^°\ 
V f (X) = V(S T X) and V^X) = V(X) are independently distributed. This, 
together with the exponential tails of V, leads to 

lim - log M(p*) = lim - log f ^ d A«V<o(A(°))-r|A-A(o)| (5 33) 

t-kx> t r^oo r J-p*(A) 

where 

dA(°) / ^ / rfV>e^'( A( ° ) )-' 3 (^ +v '/^[r(A-A( ))+/?(\/ l -V»] 

-p*(A) JO JO 

(5.33) 

and Co^ " 1 ) is the rate (Cramer) function of A^. Then, one obtains 



C(A)= max fCo(A (0) ) - |A-A (0) | 

A(0)e[-p*(A),p*<A>] L 



Co(A_)-A_+A, A<A_ 

Co(A), A^<A<A + (5.34) 

Co(A+) + A+-A, A>A+ 



where C ( A ±) = T 1 - If the FR holds for A(0) , with l A(0) l < P*( A ), the fact that 



18 For instance, in the Gaussian IK case of Eqs.(5.12,5.14), one has 



±V = — V — • F int 



dt 2K ^ m 

1=1 
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Co ((A)) = leads to 

A , |A| < (A) 

Co(A) + A, (A)<|A|<A + (5.35) 

Co(A+) + A + , |A| > A + . 

A relation similar to the heat FR of Van Zon and Cohen of [?] is thus obtained 
for A. The authors of [?] conclude that the A^-FR holds with \p\ < p*, if A^ is 
bounded or decays faster than exponential. They adopt Gentile's approach for 
Anosov flows, which reduces the flow to a Poincare map [?], and assume that 
the Chaotic Hypothesis apply to a Poincare map which avoids the singularities 
of A. This may be done taking a level section V — V, for a certain value V. 
Then, the volume contraction rate of the map, A^°\ is bounded, the terms 
(Vf — Vj) vanish, because V{ = Vf = V, and the Chaotic Hypothesis yields 
the A( )-FR. Here, the connection with the Van Zon - Cohen theory is made 
replacing the white noise with chaos due to uniform hyperbolicity. 



C(A) - C(-A) = 



5.4-2 The Evans- Searles approach 

Because A has no obvious physical meaning and the A-FR is based on strong 
assumptions which are not strictly enjoyed by systems of physical interest, one 
natural question comes to the fore: can one derive the steady state relation 
for the dissipated power divided by the kinetic energy, the f2-FR, under more 
physical assumptions? In [?], the Evans-Searles approach, first proposed in 
1994 [?], has been polished to give an affirmative answer to this question. 

Let us begin with the transient f2-FR. Let M. be the phase space, S T : M. — > 
Ai, a reversible evolution with time reversal involution operation /. Take a 
probability measure dfi(T) = f(T)dT on M, and let the observable : M — > 
IR be odd with respect to time reversal (i.e. 0(iT) = — <j)(T)). Introduce 

to , to+ r(r) = - <P(S s T)ds = y t0 , t0+T (T) (5.36) 

T Jto T 

and the Dissipation Function 

^o,*o + r(r) = \ In f^l) + ^o+^r) (5.37) 

for time even probability density / (i.e. f(IT) = f(T)). The derivation that 
follows holds in full generality, but f2 equals the dissipated power only if / is the 
equilibrium probability density for the given system, or is properly related to 
that. The existence of the logarithmic term of Eq.(5.37) has been called ergodic 
consistency [?]. For 5 > 0, let Af = (A-5,A + 5) and Aj = (-A-S,-A + S), 



90 



and let E((f> G (a, b)) be the set of points T such that <f>(T) G (a, b). Then, 
£(n , T E AJ) = IS T E(n 0jT E Aj), and the transformation T = IS T X has 
Jacobian 

e" Ao - (x) , (5.38) 



(5.39) 







dX 


= exp ( 



which leads to 



fE<Fk, T eAj) f( X ) dX lE^eAf) exp [-n ,rP0] /(*)d* 
i.e. to the transient Q-FR: 

KE(n ,r e At)) = [A+e(8,A,r)]T | £ | < £ ({J 4Q) 

which concerns the non-invariant probability measure /i of density /. Time 
reversibility is essentially the only ingredient of the above derivation. 

To obtain the steady state J7-FR, consider the ratio 

M^gw, e At)) jgcwg^) /(r>r 
M£(<W^j)) ^^/(Hdr { - } 

and take t = 2t + r. Then 

E(Kt 0+ r G i4j) = I&EQ^+r G A+) (5.42) 
so that the transformation T = 75* W, and the same algebra as above, yield 

— — — — = (expf-fto^oj) (5.43) 

Move now the evolution from sets to measures, using 

H(E) = » t0 (S t0 E) = f f t0 (W)dW (5.44) 

where E is a subset of M, /i to is the evolved measure up to time t , and f to 
its density. Some algebra yields 



y t0 (E(^ T G At)) fi to (St"E(<p toA)+T G At)) 
ft.(%, T e^)) VhoiSkE^+r G Aj)) 

_ Mg(^±r g ^)) _ _ 1 (5 46) 

»(E(Kt 0+ r G AJ)) (exp (-fi ^))^_ to+TeA + • 

We call 0-FR this relation. For (fi t(hto+T = f2i 0ito+T , taking the logarithm and 
dividing by r, it produces: 
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l h ^(%^ + )) 



T 



A + e(8, t , A,t)-- In / e - t "(^.*o+^o+-.2*o+-)\_ (5..47) 

If fj, to tends to a steady state /i^ when t — > oo, the above should change from 
a statement on the ensemble f to , to a statement concerning also the statistics 
generated by a single typical trajectory. A result like this would be the steady 
state fl-FR. This requires further assumptions, because to tends to infinity 
before r does and, in principle, the growth of to could make the conditional 
average in (5.47) diverge. Nevertheless, the decay of the auto-correlation of f2 
suffices. Indeed, the conservation of probability yields 



V sn °' s ) = 1 , for every s G M , (5.48) 
and if the ^-autocorrelation time vanishes, one can write: 



g-*0^0,t g-*of2i +T,2t +T 

1 g-to(^0,t +^t +r,2t +r)^ _ ^g-*0^0,t ^ ^g-*0^t +T,2t +r ^ (5.49) 

and 

1 = ^ e -«no,.-(t- s )n.,^ = ^ e -no,.^ ^ e -n.,«^ =^ ^ e -(t- s )n.,^ = 1 for all Sjf _ 

(5.50) 

Hence, the logarithmic correction term in (5.47) identically vanishes for all 
t , r, and the f2-FR is verified even at short r's. Of course, this idealized situ- 
ation does not need to be realized. Nevertheless, tests performed on molecular 
dynamics systems indicate that there exists a constant K, such that [?,?] 

< — < / e -*°(^O,i +fVr,2 t0 +r)\_ < K . (5.51) 

As a matter of fact, the decorrelation (or Maxwell time), tu-, expresses a 
physical property of the system, thus it does not depend on t or r, and 
depends only mildly on the external field [usually, t M (F e ) = tu^) + 0(F e 2 )]. 
Its order of magnitude is that of the mean free times. If these scenarios are 
realized, Eq.(5.51) follows and the logarithmic correction term of Eq.(5.47) 
vanishes as 1/r, with a characteristic scale of order 0{tu)- 

It results that the steady state f2-FR can be obtained basically only from time 
reversibility and from the decay of the ^-autocorrelation, and one can write 

- In /U£(go,, € Aj)) =A correction (5 52) 
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where the small correction can be made arbitrarily small taking sufficiently 
large r and sufficiently small 8. This decay of correlations could be relaxed 
or replaced by other assumptions, but is needed for the convergence to a 
steady state, and is verified in most systems of physical interest. Furthemore, 
this approach explains why the relevant convergence times are functions of 
material properties of the systems, and do not diverge in the equilibrium 
limit. The decorrelation times of fl are indeed material properties. 

Various other relations can now be obtained. For instance, for any odd 0, any 
5 > 0, any t and any r, one has 

(exp(-tn , t ))^^ +Te( _ 5i5) = l (5.53) 

which, in the 5 — > oo limit, leads to the well known normalization property - 
the so-called Nonequilibrium Partition Identity (5.48). Given a second density 
/ and the corresponding Q, one has 

exp w TM^W) * (exp (-*^)>w^ • 

(5.54) 

for large to, all r and all allowed pairs A and —A, if dfi = fdT and djl = fdT 
converge to the same steady state. Then, as far as the FRs are concerned, the 
different dissipation functions are equivalent. The Dissipation Relation 

(0) t = f ' ds(n{0)<j){s)) , (5.55) 
Jo 

where {.)t the average with respect to [it, is another direct consequence of the 
approach followed in this section [?]. 

The theory outlined above is consistent with Irreversible Thermodynamics, 
since it leads to the Green-Kubo relations, close to equilibrium [?] ; hence it can 
be considered in the construction of a more general theory, which encompasses 
far from equilbrium phenomena. Differently from Ref.[?], which deals with 
A and with asymptotic times, Ref.[?] deals with f2 and stresses the role of 
the physical time scales. This is illustrated on a Nose-Hoover thermostatted 
system [Eqs.(5.16)], whose equilibrium state is given by the extended canonical 
density 

/c(r ' () = /^« ^ Q = 2K ° 6 (5 - 56) 

where Hq is the internal energy [?]. In the most common case, in which Ff xt = 
c;F e and J = J2f=i <k(d<li/dt), one has 



2K 



dt 
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and 



where d is the spatial dimension, which shows that A and its fluctuations are 
not directly related to the dissipation rate Q = J • F e V/2K, while its average 
is, because (H ) = 0. Integrating / c (x, £) yields 



/ c (0 = / dT/ c (r,0 = exp [-we 2 /2] • (5.57) 

Therefore, the distribution of £ 0i is also Gaussian in equilibrium, with variance 
proportional to that of ho jt = (1/i) JqHqcIt, and near equilibrium it can be 
assumed to remain Gaussian, around its mean, for large t, as a consequence of 
the Central Limit Theorem (CLT). To use the A-FR together with the CLT, 
the values A and —A of the random variable £ ,t m ust be a small number of 
standard deviations away from (Q) = (J) • F e V/2K, where K is the kinetic 
energy. However, as explained in Refs. [?,?,?] and briefly recalled in Section 
5.4.1, the distribution of dN^ ot verifies the A-FR only for times t sufficiently 
large that the standard deviation of the random variable h j is negligible with 
respect to that of fi ,t, a n ot sa y- 



In [?] it was proven that the variance of the average current obeys 



(5.58) 



hence that of Q 1 obeys 



F e V 

2K 



2L(F e )k B T (FT 
V + UN. 



(5.59) 



where 



L(F e )=(3V dt((J(t) - (J))(J(0) - (J))) 



and L(0) = lim^^o L(F e ) is the corresponding linear transport coefficient. 
Equation (5.58) shows that the standard deviation of the average current 
decreases when t grows at fixed F e , while it tends to a positive constant, when 
F e decreases at fixed t. Consequently, the standard deviation of fl 0jt tends to 
zero when F e — > at fixed t. Differently, the variance of ho,t tends to a constant 
when F e tends to zero at fixed t. Therefore, the smaller F e the longer the time 
t needed for ctq to dominate over the variance of h 0>t , and this time grows 
without bounds when F e tends to zero. Let us assume for simplicity, that 
the variations of these standard deviations are monotonic when either F e or t 
varies and the other variable is fixed. Then, given F e and A, there is t a (F e , A) 
such that the standard deviation of Ao,t is sufficiently large that A and —A 
are within a few standard deviations from the mean only if t < t a (F e , A). At 
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the same time, let ts(F e ,A) be sufficiently large that the steady state A-FR 
applies to the values A and —A, with accuracy 5. To derive the Green-Kubo 
relations from the A-FR, one would need 

t s (F e ,A) <t<t a (F e ,A) (5.60) 

which is not satisfied if ts{F e , A) grows too fast with decreasing F e . This sug- 
gests that the derivation of the Green-Kubo relation from the A-FR is prob- 
lematic, for systems like the Nose-Hoover systems or the Gaussian isokinetic 
systems with singular interaction potentials. In Ref . [?] it is further shown that 
the validity of Eq.(5.60) is necessary but not sufficient to obtain the result. 

Differently, there is no problem in obtaining the Green-Kubo relation from the 
f2-FR , because the corresponding convergence times do not diverge when F e 
tends to zero (as seen above, they become of the order of the Maxwell times), 
and because fl is the observable of interest (the energy dissipation rate divided 
by the kinetic energy). For times t of the order of the Maxwell time, one may 
then write [?]: 

t ( J) r°° 

(fi) = -4 o t or L(0) = Km ^ = (3V jf ds <J(0)J(s)> (5.61) 

where the first equality is due to the validity of the f2-FR and the second to 
(5.59). 



5.4-3 The Jarzynski and the Crooks relations 

A transient relation for the fluctuations of non-dissipative systems has been 
obtained by Jarzynski [?] . 19 To introduce this relation, the author considers 
a Hamiltonian finite particle system, in equilibrium with a heat bath at tem- 
perature T, which is driven away from equilibrium, by performing some work 
W on it. If A is a parameter that controls the Hamiltonian H\ say, the work 
is performed varying A. Let A = \{t) be a given protocol of duration r for a 
variation of A from a value A(0) = A to another value A(r) = B. Suppose that 
the same protocol is repeated many times, always in the same manner, and 
always from the equilibrium corresponding to A = A, to build the statistics 
of the work done when A evolves from A to B. Let p be the PDF of the ex- 
ternally performed work and (e _/3W/ ) a-^b the average over all works done in 
varying A from A to B. These works are not the thermodynamic work done on 
the system, if the process is not performed quasi-statically, in the presence of 
local equilibrium [?], but is nevertheless a measurable quantity. The Jarzynski 



9 The non-invariant ensemble, which characterizes the "transient" nature of the 
Jarzynski equality, is the initial canonical ensemble. 
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equality states that [?]: 



-? w ) a ^ b = JdW p(W)e^ w = e -^B)~F { A)] {5 62) 

where f3 = l/k B T, and [F(B) — F(A)] is the free energy difference between 
the initial equilibrium, with A = A and the equilibrium state corresponding 
to A = B. This state exists and is unique, hence the value of the state variable 
F at A = B is well defined, but it does not need to be the actual state of the 
system at time r. Indeed, the work W is performed on the system in the time 
interval [0, r], while relaxation to the equilibrium corresponding to A = B may 
require longer times, depending on the explicit form of the protocol A(t). Note 
that the process always begins in the same equilibrium state corresponding to 
A = A, but in different microscopic states. In general, at time r, the system will 
not even be in local equilibrium: Eq.(5.62) is supposed to hold for all possible 
protocols, hence even arbitrarily far from equilibirum (large 4A). Therefore, 
the presence of the equilibrium quantities F(A) and F(B) may look puzzling. 
The puzzle is solved observing that the externally measured work does not 
need to coincide with the thermodynamic work (which would not differ from 
experiment to experiment, if performed quasistatically, cf. Section 5.4.4). From 
an operational point of view, it does not matter whether the system is in 
local equilibrium or not: the externally applied forces can be measured, the 
resulting motions can be recorded, hence the externally performed works are 
defined and can be quantified. The difference of this process from a standard 
thermodynamic one is that the external work cannot be equated to the internal 
thermodynamic work, if the process is not performed quasi-statically. 

The limitation of Jarzynski's derivation, that the dynamics be Hamiltonian, 
has been overcome by Evans in terms of NEMD models [?]. Therefore, the 
Jarzynsky equality, similarly to the transient f2-FR, results of quite wide ap- 
plicability, since it does not rest on particular conditions on the microscopic 
dynamics. It is also consistent with the second law of thermodynamics, since 
it yields 

(PW) A ^ B > P [F(B) - F(A)} (5.63) 

because In ($) > (ln$) for positive observables $, although {W) A _^ B is not a 
thermodynamic quantity in general. 

Similarly, computing the ratio of the probability that the work done in the 
forward transformation is W, to the probability that it is — W in the B to 
A transformation, with reversed protocol — ^A, produces the Crooks relation 

[?]: 

PTQb A ^ B (W = a) _ f] [F{ B)-F{A)} a ( r ^ 

Prob B ^ A (W = -a) 1 } 

which leads to the Jarzynsky equality, by a simple integration: 
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-pw\ 

A-^B 



\ 6 



J Yioh A ^ B {W = a)e- a da = e -^(B)-F(A)] J ProbB _ A (^ = _ a ) da 

= e -0[F(B)-F(A)] (5 _g 5) 

A relation exists between these results and the f2-FR. In the first place, the 
transient f2-FR may be applied to the protocols of the Jarzynski equality and 
of the Crooks relation, [?]. Then, let Ja and f B be the canonical distributions 
at same inverse temperature [3, for the Hamiltonians Ha and H B - The cor- 
responding Helmholtz free energies are = —k B Tln j dc\dpexp[—Hi/k B T} 
for % = A,B. For simplicity, let A go from A to B in a time r, with rate 
j- t \ = 1/r, and from B to A with rate J^A = — 1/r. Correspondingly, the 
microscopic thermostatted evolution equations are 



d dH x (q,p) d dH x (q,p) 

^ q = ^p— ' Jt p = s5 eMx)p > (5 - 66) 

^-A = ±- , with + for A -> 5 and - for 5 -> A (5.67) 
dt r 

where = 1 for i = 1, ...iV w and = for i > N w , so that the deterministic 
thermostat acts only on the iV„, particles of the walls of the system, to fix 
their kinetic temperature and mimic a heat bath at temperature T. Then, the 
work performed by the external forces is given by f3W = f3[H B — Ha] — A 0)T . 

If A = B, the fi-FR applies directly, and the Jarzynski equality is an imme- 
diate consequence of the f2-FR because the f2-FR implies 



e -pw 



J P(W)e~ l3W dW = J dWP(-W) = 1 (5.68) 



The transient f2-FR, the Jarzynski equality and the Crooks relation do not 
have the same range of applicability, the Crooks relation being the most gen- 
eral. It is remarkable how all of them connect equilibrium to nonequilibrium 
properties of physical systems: the transient fi-FR deals with the energy dis- 
sipation associated with the application of a dissipative field to an ensemble 
of systems initially in equilbrium; the Jarzyinski and Crooks relations relate 
the work done to the free energy differences. The point of view of NEMD is 
important in this context, because finite Hamiltonian systems do not afford 
nonequilibrium steady states and also because, in general, external drivings 
do not need to preserve the Hamiltonian nature of the dynamics. Therefore, 
the agreement, where appropriate, with the NEMD approach strengthens the 
results. The interest of all these relations is bound to grow with our under- 
standing of microscopic systems, particularly in biophysics and nanotechnol- 

ogy 
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The connection between equilibrium and nonequilibrium properties made by 
the fi-FR, the Jarzynski equality and the Crooks relation is, in a sense, op- 
posite to that made by the Fluctuation Response formula: while the relations 
treated in this subsection obtain information about equilibrium states from 
nonequilibrium dynamics, the Fluctuation Response formula uses equilibrium 
fluctuations to gain information on nonequilibrium states. 

5.4-4 Ensemble vs thermodynamic relations 

There is a substantial difference between the transient relations considered in 
this Section (see also, e.g. [?]), and the Fluctuation Response formula. The 
Fluctuation Response formula concerns thermodynamic properties of macro- 
scopic objects, hence it holds for the behaviour of a single system. Differently, 
as previously observed, the transient relations concern the statistics of ensem- 
bles of objects. Nevertheless, the transient relations are sometimes confused 
for thermodynamic statements. This is due to the fact that the transient rela- 
tions either have forms similar to the second law of thermodynamics, or can be 
used to obtain relations formally like the second law. Also, the statistical na- 
ture of the results concerning a collection of particle systems, is often confused 
for the statistics concerning the many particles of a single system. Obviously, 
this is not appropriate, and the importance of the transient relations must be 
found precisely in their unavoidable ensemble nature, not in their thermody- 
namic content. Indeed, the differences between the two kinds of relations have 
practical consequences, which can be understood as follows: 

1. Thermodynamic statements do not refer to ensembles of systems, they con- 
cern single systems. If one has a collection of systems in the same ther- 
modynamic state, they all behave in the same way, hence their average 
behaviour is, a fortiori, bound to be that of a single member of the collec- 
tion. For this reason, one may resort to a microscopic statistical description, 
in which each single system is in a different microscopic state, in order to 
recover the unique common thermodynamic behaviour. This macroscopic 
behaviour emerges when the time and space scales are well separated from 
the microscopic scales, and sufficiently mixing processes take place. In that 
case, the differences among the ensemble members are not observable: they 
cannot be expressed in terms of thermodynamic quantities, such as the ther- 
modynamic work W done on a system. Equivalently, one may say that the 
differences vanish typically as 1/ y/~N, where N is the number of particles of 
each system in the collection. Thus, sufficiently large N implies practically 
no differences in the behaviours of the collection members. 

2. If work is done in a reversible fashion on a macroscopic system, one can 
draw the corresponding path of thermodynamic states in the, e.g. pressure- 
volume plane. Integrating along this path, one obtains a given value for the 
work done on the system, which is operationally accessible, by measuring 
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the work done by the external equipment. In this case, the system and the 
working apparatus are globally in close contact all the time, and the energy 
given to the system, under a fixed protocol, is always the same. Therefore, 
the ensemble average and the single works are equal, and equal the internal 
and the external works. 
3. If work is not done in a reversible fashion, one obtains different values for 
W, even if the same protocol is repeated. The energy that a single system 
may acquire from the experimental apparatus cannot be predicted, and 
only averages over many repetitions of the protocol may be inferred. The 
transient relations serve to this purpose. It is interesting to observe that 
this is the case even for large N. Indeed, given a large collection of systems, 
the different values of the works performed on them (not to be confused 
with fluctuations in the evolution of a single system) are not due to the size 
of N, but to the fact that the process is not quasi-static, and corresponds 
to no path in the space of thermodynamic states. The reason is that the 
energy exchanged between system and driving apparatus depends on the 
microscopic initial state, not just on the driving protocol. Every time the 
protocol is repeated, the microstate is different, hence a different value for 
W is obtained. This value is unpredictable, because the initial microstate is 
unknown, moreover different initial ensembles lead to different statistics. 

Therefore, the content of the ensemble relations in far from equilibrium pro- 
cesses is not, e.g. the impossible quantification of the dissipative works, but 
the statistical description of large collections of systems. Indeed, they describe 
intriguing properties of the chosen initial ensembles. The fact that only in cer- 
tain limits are the transient relations equivalent to thermodynamic statements 
is not a difficulty, because they have the advantage of being valid even when 
the thermodynamic description fails (e.g. in the absence of local equilibrium, 
or for systems of a small number of particles). 



6 Fluctuation relations in stochastic systems and applications 

6.1 Stochastic systems: bounded and unbounded state spaces 

The derivations of the FR for stochastic systems are much easier than those 
of the A-FR, because, as noted in [?], the difficulties connected with singular 
invariant phase space distributions are avoided, and one can deal with smooth 
probability distributions. 20 The first of the stochastic FRs was produced by 



Note that for the same reason the derivation of the S7-FR given in Section 5, 
which deals with the evolution of probability densities, is technically much easier, 
and of wider applicability than that of the A-FR. 
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Kurchan, who obtained a modified detailed balance property for Langevin 
processes of finite systems, and a FR for the entropy production, under a 
few assumptions, like e.g. the boundedness of the potential [?]. Lebowitz and 
Spohn [?] extended this result to generic Markov processes with a finite num- 
ber of states. Additionally, under the assumption that local detailed balance 
is attained, they showed that the Gibbs entropy production is related to the 
action functional that satisfies the FR. This means that for Markov processes 
the Gibbs entropy production plays the role of the phase space contraction rate 
in the A-FR. Maes obtained a large deviation principle for discrete space-time 
Gibbs measures [?] . He showed that using the Gibbs formalism to describe the 
steady state of time discrete lattice systems leads to a FR for a kind of Gibbs 
entropy production. These results can be seen as a generalization of the A-FR 
and of its stochastic versions, as stochastic dynamics and thermostatted sys- 
tems satisfying the chaotic hypothesis are particular cases of space-time Gibbs 
measures. 

Farago pointed out that singularities may cause difficulties in the conventional 
use of the FR, for stochastic systems [?]. Wang, et.al., reported the experiment 
of a colloidal particle that is dragged through water by means a moving optical 
trap [?] , confirming an integrated version of the transient FR. This experiment 
may be modelled through a stochastic Langevin evolution describing a Brow- 
nian particle, dragged in a liquid by a moving harmonic potential, a problem 
studied by various authors [?,?,?,?]. In particular, analyzing the results of [?], 
Van Zon and Cohen [?] observed that, in the presence of a potential term, the 
work done on the system in a time r, W T , consists of two parts: the heat Q T 
corresponding to the energy dissipated in the liquid, and the potential energy 
difference of the Brownian particle AU T : 

W T = Q T + AU T . (6.1) 

A Brownian particle in a fluid, subjected to a harmonic potential that moves 
with a constant velocity v*, is described by the overdamped Langevin process 

*& = -[x(t)-x*(t)]+at), (6.2) 

where x(t) is the position of the particle at time t, x*(t) = v*t is the prescribed 
position of the minimum of the potential and ((t) is a white noise term rep- 
resenting the fluctuating force the fluid exerts on the particle. The units used 
are such that ksT = 1. The total work is given by 

W T = -v* f T [x(t) - x*(t)]dt . (6.3) 

JO 

In a comoving frame Eq. (6.2) reduces to a standard Ornstein-Uhlenbeck pro- 
cess and thus, the stationary probability distribution and Green's function 
are Gaussian in the particle's position. Since the total work is linear in the 
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particle's position, W T is Gaussian as well. Because of this and of Eq. (6.3), 
in the case of transient fluctuations, the variance of W T equals 2(W T ). Since 
W T is Gaussian, the total work satisfies the transient FR. In the r — > oo limit, 
the variance of W T remains twice its mean, hence the total work satisfies the 
steady state FR. 

Van Zon and Cohen pointed out that the quantity measured in the experiment 
of [?] was precisely the total work and thus, in agreement with their Langevin 
treatment. However, they also clarified that, while the PDF of the total work 
is Gaussian, at equilibrium the PDF of the potential energy is exponential: 
P(AU) ~ exp(— const. AC/), and is expected to remain such in the steady 
states. Therefore, while the small fluctuations of heat are expected to coincide 
with those of the total work, since the contribution of the potential energy 
is only 0(1), large heat fluctuations are more likely to be due to a large 
fluctuation of the potential energy. 

Consider the harmonic potential U(t) = \\x{t) — x*(t)\ 2 in Eq. (6.1). The 
heat Q T is nonlinear in the particle's position, hence its PDF needs not be 
Gaussian. Compute the Fourier transform of this PDF: 

P T (q) = / dQ T e iqQ -Proh T (Q T ) . (6.4) 

Writing Prob T (Q T ) in terms of the joint distribution of the work W T and of 
the positions x(0),x(t), one obtains 

p (n) _ 6XP H*~ g) ( T - l+\ 2 l-e ! ^ )} , fi 
fAQ) ~ [l + (l- e -2r) g 2]3/2 > W 

where w = (W T )/r is the rate of work done in the system, related to the 
stationary state average. Anti-transforming P T (q), one considers the heat fluc- 
tuation function 



frip) = — In 

WT 



Prob T (pwr) 



r , (6.6) 
Prob T (— pwr) J 

where p = Q T /(Q T ) and (Q T ) = (W T ) - (AU T ) = wt, since (AU T ) = 0, in 
the steady state. To obtain an asymptotic analytical expression of Eq. (6.6), 
consider the quantity 

e(A) ee lim — -(e- XQT ) , (6.7) 

for large r, and 

Prob T (Q r ) ~ e -^e(Q r /wr) ? ^ 

where e(p) = max{ A } [e(A) — Xp] is the Legendre transform of e(A). Analytically 
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continuing P T to imaginary arguments, one can write (e XQt ) = P T (i\), i.e. 



exp 



l e -\Qr\ _ f L ^ n l-(l-e 2r) A 2jj 

I [l_(l_ e -2r) A 2]3/2 > W 



which is singular for A = ±(1 — e 2r ) 1 / 2 . Using Eqs. (6.7) and (6.9) and 
taking the r — > oo limit, the singularities move to ±1, yielding 

e(A)=A(l-A) for |A| < 1 . (6.10) 

This implies that the conventional steady state FR, lim T _ ( . 00 f T (p) = p, holds as 
in Ref.[?]. Outside the interval (—1, 1), the integral in Eq. (6.8) diverges due to 
the exponential tails of the PDF of Q T : e(A) = — oo for |A| > 1. Finally, taking 
these values in the Legendre transform e(p), and substituting in Eq. (6.8) one 
obtains 



lim f T (p) 



p for < p < 1 

p-(p-lf/A for 1 < p < 3 (6.11) 
2 for p>3 



and the values for negative p are obtained from f T (—p) = —f T {p)- The fluctu- 
ations of heat that are smaller than (Q T ) satisfy the conventional FR, as those 
of W T ; larger heat fluctuations behave differently, in particular, the probability 
ratio f T is much larger than that predicted by the conventional FR. A simi- 
lar phenomenon can occur in deterministic systems [?,?], and the logarithmic 
term in the definiton of Q, Eq.(5.37), represents the corresponding boundary 
terms. 

The validity of the extended FR of Van Zon and Cohen has been addressed 
in other stochastic systems. For instance, Ref.[?], where a granular system is 
also considered, studies the extended FR, and shows that the boundary terms 
may be important in many common situations. One interesting feature of the 
models considered in [?], is that the granular system behaves very similarly to 
a simple Markov chain with unbounded state space, as discussed in Subsection 
5.4.1. Somewhat different results are reported in Ref.[?], which shows that the 
extended FR does not hold in the partially asymmetric zero-range process 
with open boundaries. Hence the range of validity of the Van Zon - Cohen 
scenario is still to be fully understood. 

Various other studies have dealt with the problem of a Brownian particle and 
Langevin process in general, like those of Refs. [?,?,?,?,?,?,?,?]. In particular, 
Ref. [?] points out that exponential distributions of the boundary terms may 
not always have the same effect on FRs, hence the problem of their relevance 
in FR remains open. 
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Relation 


State 


Dynamics 


Observable 


(5.1) 


NESS 


Gaussian thermostatted 


DP 


(5.22) 


NESS 


Reversible transitive Anosov 


A 


(5.29) 


NESS 


Reversible transitive Anosov 


Local- A 


(5.35) 


NESS 


Reversible flow with transitive 
Anosov Poincare map 


Local- A 


(5.39) 


SMe-NE 


Reversible and dissipative 


Q 


(5.43) 


SMe-NE 


Reversible and dissipative 




(5.48) 


SMe-NE 


Reversible and dissipative 


Q 


(5.55) 


SMe-NE 


Reversible and dissipative 


Q 


(5.52) 


NESS 


Reversible and dissipative 
^-correlation decay with 

xespeci lu iiiiLidi inedsuie 


Q 


(5.62) 


C-NE 


Hamiltonian dynamics 


F 


(5.64) 


C-NE 


Hamiltonian dynamics 
or Markov process 


F 


(6.11) 


NESS 


Markovian model of 
colloidal particle in optical trap 


HF 



Table 1. Synoptic table of fluctuation relations. The first column gives the equation 
number. The second column gives the details of the state for which the relation 
holds: NESS means nonequilibrium steady state, C-NE means experiments starting 
in canonical equilibrium and continuing under nonequilibrium dynamics, SMe-NE 
means initial smooth ensemble followed by nonequilibrium dynamics. The third 
column specifies the dynamics for which the relation has been obtained. In the fourth 
column, the observables for which the relation holds are given: DP means dissipated 
power, A means phase space contraction rate, £1 means dissipation function, (f> is 
any odd observable, F is the Helmholtz free energy. Local means: integrated over a 
given region of the relevant space, HF means heat flux. 

6.1.1 Markov chains with an infinite number of states 

The problem of singularities in unbounded spaces can be understood in detail 
using a simple model [?,?]. Consider a Markov chain with N (possibly infinite) 
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states with invariant probability measure /x = {fi a } and transition rates K ab 
which denote the conditional probability of going from state a to state b. We 
are interested in the fluctuations of the following two "action functionals" : 

W{r) = ±\og^p^ (6.12a) 

W\t) = J2 log §^ + log (6- 12b) 

(6.12c) 

where cr, G {1,2, ...TV} is the state of the system at time i. Both function- 
als have been defined by Lebowitz and Spohn, in [?], who focused on the 
properties of W, neglecting the importance of the difference B = W — W. 
Both W and W associate a real number to any finite trajectory (any real- 
ization of the Markov chain). In a stationary state which verifies the detailed 
balance condition [i a K ab = fj,bK ba , one has W'(t) = 0, while W(t) ^ (ex- 
cept when K ab = K ba ). For t large enough, almost all the trajectories yield 
hm 8 ^ 0O W(s)/s = lim^oo W'(s)/s = (W(t)/t) = (W'(t)/t), where (assuming 
an ergodic and stationary system) () indicates an average over many indepen- 
dent segments from a single very long trajectory. Let S — — X^=i v % log i>i be 
the Gibbs entropy of the system at time t, where vi{t) is the probability to be 
in the state i at time t; then 

S(t + l)-S(t) = E(t)-A(t) (6.13) 

where S(t) is always non- negative, A(t) is a linear function with respect to 
u(t) = \ui(t)}, and (W(t)) = (W'(t)) = f*dt'A(t'). In [?] this has been 
shown for continuous time Markov processes, but the proof is valid also in the 
discrete time case (see for example [?]). This leads to consider W(t) and W'(t) 
equivalent for the contribution of a single trajectory to the total entropy flux. 
In a stationary state A(t) = S(i) and therefore the flux is equivalent to the 
production. For large enough t one has: 

(1) at equilibrium (i.e. when there is detailed balance) (W(t)) = (W'(t)) = 0; 

(2) out of equilibrium (W(t)) > and (W'(t)) > 0. 

Consider the fluctuations of the functional W. We first define an extended 
probability vector p(t,W), whose component Pi(t,W) is the probability of 
finding the system at time t in the state i, with value W for the Lebowitz and 
Spohn functional. This means that J2iPi(t,W) = f(t,W) is the probability 
density function at time t for the functional W, while / dWpi(t, W) = Vi(t) is 
the probability of finding the system in state % at time t and / dW Y^iPi(t, W) = 
1. The evolution of p(t, W) is given by the following equation: 

Pi (t + 1,W)=J2 KjiPjif, W - Awji) (6.14) 
j 
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where K is the previously defined transition matrix and Awij is the variation 
of W due to a jump from the state % to the state j. This reads Aw^ = In 
Then define the function p(t, A) = / dW exp(— XW)p(t, W) and obtain, for its 
evolution 

p(t + l,A) = A(X)p(t,X) (6.15) 
A(X) being the matrix defined by 



^(A) = Kj- X K", 

and, therefore, 

p(f, A) = A(A)«p(0, A) 
with pi(0,X) = J dW exp(-XW)vi(0)5(W) = ^(0). 



(6.16) 
(6.17) 



The characteristic function of the distribution of W is obtained summing over 
all the states: 

f(t,X) = J>(*, A) = ££L4(A)V,(0) =E",(0)EMv- (e- 18 ) 



The distribution of W at time t is recovered by inverting the Laplace trans- 
form: 

/+ioo _ 
dAexp(AW0/(f,A). (6.19) 
-ioo 

Furthermore, the knowledge of the characteristic function suffices to compute 
the moments or the cumulants of W: 



d r - 



A=0 



W> c = (-l) B ^log/(f,A) 



(6.20a) 
(6.20b) 



A=0 



At large times, the evolution operator A(X) f is dominated by the largest eigen- 
value ?/i (A) of A(X). Defining yi(A) = exp(£(A)) it follows that 



p(*,A)~exp(C(A)0 
/M)=£ft(f,A)~exp(C(A)f) 



E^a^o) 



x (1) (A) (6.21a) 
E4 1} (A), (6.21b) 



where x^(A) is the eigenvector of A(X) associated to the largest eigenvalue 
yi(A). One expects, from the above large times behavior, an analogous large 
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time behavior for the density distribution of W, i.e. 



/+JOO 

- i0 ° 3 i 

r / w m 

tmax ( X— + C(A)J = exp[t7r(W/t)] (6.22) 



cxp 



where we have introduced n(w) = lim^oo | log /(t, wt), the large deviation 
function associated with /(i, W), which is obtained as a Legendre transform 
of C(A), i.e. tt(w) = \*w + ((\*) with ^((A)| a =a* = —w, under the validity of 
the last chain of equalities. 

The previously defined Fluctuation Relation appears at this stage. In fact, 
it is evident that A(X) = A T (1 — A), being A T the transpose of A. This 
implies that £(A) = ((I — A) which suffices to get n(w) = ir(—w) + w, i.e. 
f(t,W) = f(t, — W) exp(W) at large times. The validity of the expansion 
in (6.22) is crucial for the validity of this relation, but it is not guaranteed 
when the integrand presents non-analyticities in the A complex plane. Such a 
catastrophe can happen, for example, when the number of states N becomes 
infinite and the initial (final) probability fij^(0) has some unbounded form 
(see below). The physical meaning of such a catastrophe is that the large 
fluctuations in the initial and final state cannot be neglected, because they 
contribute to the tails (i.e. the large deviations) of f(t, W) at all times. Note 
that the breaking of analyticity of f(t, A) is associated with large fluctuations 
of invariant probabilities. Many studies, including numerical simulations [?], 
analytical calculations [?,?,?] and heuristic arguments [?], show that the initial 
and final configurations modify the standard picture when the distribution of 
the boundary term B = In /V(o) — hi /i a ^ has exponential, or higher, tails in 
the stationary state. This may occur even if ^ has Gaussian tails. 

Let us see what happens to the functional W which differs from W only 
for the non time-extensive term B, letting the prime denote quantities which 
involve this functional. For example, we denote the extended measure vector 
by p'(t,W) and the probability density function at time t by f'(t,W), the 
characteristic function by f'(t, A), etc. The increment of the functional at each 
jump reads Aw^ = Aiu^Tog (j^), recalling that /ij is the invariant measure 
for the state i. The evolution matrix therefore reads 

Ay(\)=K}r*K&jW, (6.23) 

and the evolution equation reads 

p'(t + l ) A)=A'(A)p'(t ) A). (6.24) 

The fundamental difference between W and the original W appears now. 
Since p'(0, A) = f(0), if one takes v(0) = n (the system is in the stationary 



106 



regime from the beginning), it happens that 

a) = a) = EE4(% = EE^r A 4^V, (6.25) 

i i j i j 

i.e. /'(I, A) = /'(l, 1 — A). By recursion, one realizes that this is the case for 
all times t, i.e. 

f'(t,\) = f'(t,l-X), (6.26) 
in general, which leads immediately to a finite-time symmetry relation 

/'(t,W) = / , (t,-W)exp(W / ), (6-27) 

valid for any t. 

The functional W contains a term that cancels the effects of the fluctuations of 
the steady state measure, leading to a conservation of the symmetry A — > 1 — A 
all along the evolution. Such a conservation prevents surprises at large times 
also in presence of large fluctuations of the initial measure. 

As an example of the above discussion [?], consider a Markov chain with N + 2 
states, labeled A, B and Cj with i e {1, 2, ...N} and with a transition matrix 
K defined by 

1 1 Paa Pab (1 - Paa - PAB)h (1 - Paa - Pab)^ • • • (1 - Paa - Pab)&n^ 

{l-PBA)h (l-pBA)k 2 ■■■ (l-PBA)k N 

••• 

••• 

J 

(6.28) 

with J2iLi ki = 1, under the constraint that, for every jump of positive transi- 
tion probability, the reversed jump is also possible. The invariant probability 
H for iV = 1 is given by 

Pba + Pca - PbaPca la on % 

Ha = jf (6.29a) 

1 - Paa + Pca(pab + Paa - 1) (a oau , 

Hb = jf (6.29b) 

1 - Paa - PabPba la on \ 

He = jf (6.29c) 

with J\f = 2 + p AA (-2 +Pca) + PabPca ~ Pba(-1 + Pab + Pca)- 

It can be easily seen that the invariant measure for iV > 1 is closely related 
to the case N — 1 with a decomposition of the measure of state C\ into the 



Pba 







Pca 


1 


-Pca 


Pca 


1 


-PCA 


K : 







107 



measures of Cj proportional to the values kf. 



(6.30) 



In numerical simulations of this model [?], the functionals W(t) and W'(t) 
can be measured along independent non-overlapping segments of duration 
r, extracted from a unique trajectory after the stationary regime has been 
achieved. Then, the following relation can be verified: 



where F(t,X) is the probability density function of finding one of the two 
functionals W or W after a time t equal to X (i.e. F(t, X) corresponds to 
f(t, W) or to f'(t, W) depending on the cases). Some typical results are shown 
in figures 16, which show the graph of G T vs x and the pdfs of W and W. 
The phenomenology can be divided in 3 main cases, depending on the choice 
of the transition rates. Whenever detailed balance is satisfied (here when A 
is disconnected from all Cj's, i.e. when pab — 1 — Paa and pca — 0), W'(t) 
is identically zero and does not fluctuate (its pdf is a delta in zero), as ex- 
pected, and therefore W(t) coincides with the opposite of the boundary term 
B = log — : they both have symmetric fluctuations around zero with expo- 



nential tails, and G T = 0. When detailed balance is violated (i.e. when A is 
connected to all Cj's) both W(r) and W'(t) fluctuate around a nonzero (pos- 
itive) value which, for r large enough, is the same for the two functions. In 
general the fluctuations of the boundary term B = log have a pdf with 
exponential tails and the pdf of W is almost perfectly Gaussian. This is not 
true for the pdf of W. At small times (r = 100) the pdf of W resembles the 
pdf of B, evidencing that at this time W is completely dominated by B. At 
larger times the pdf of W and B start to deviate, in particular that of W tends 
to that of W in the bulk, with evidently different tails of exponential form. 
The tails of the pdf of W are always dominated by the fluctuations of B. The 
symmetry relation for the functional W is not verified in any of these simula- 
tions, both at small and large times. The asymmetry G T (W) has a slope near 
1 only for small values of W <C (W), then deviates and saturates to a con- 
stant value in good agreement with the value 2{W) predicted by van Zon and 
Cohen [?]. Note that the observations at large times are perfectly compatible 
with those at small times, i.e. if both ordinates and abscissas are divided by r, 
the curves are similar (in the first two cases they overlap very well). Therefore 
the "reduction" of the violation at large times is only apparent. On the other 
hand the symmetry relation for W is always satisfied, at all times and for all 
the choices of the parameters. Finally, when the choice of the rates fcj is such 
that the invariant measure on states Cj is an exponential with a very high 
slope, the numerical results show that the fluctuations of W are much closer 
to those of W already at small times. This is reflected on the good agreement 
with the FR of both functionals W and W. One can still be doubtful about 



G T (X) = log F(t,X) - log F(t, -X) = X 



(6.31) 
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this verification, because of the limited range of values of W available, which 
can possibly hide a failure at larger values. The distribution of the boundary 
term, in fact, still has exponential tails (invisible at our resolution) and it can 
be argued that these tails (being Gaussian those of W) will dominate at very 
large values. 



Fig. 16. Study of the boundary terms for the Fluctuation Relations in the Markov 
chain discussed in the text. Top graphs: probabilities of observing W (black squares), 
W' (red circles) and B = W' — W (green lines). Bottom graphs: G T (W) vs. W 
(black squares) and G T (W') vs. W' (red circles). The dashed line has slope 1. The 
dotted horizontal line marks the van Zon and Cohen prediction for the FR violation, 
G T (W) = 2{W) for large W [?]. The left column is at time r = 100 and the right 
column at time r = 1000. In the simulation we have used N = 50, paa = 0.2, 
PAB = 0.3, pba = 0.3 and pca = 0.5 and hi oc exp(-ai) with the value of a given 
in the plot. In all cases (W(t)) = (W'(t)} = 0.0053r, i.e. 0.53 for r = 100 and 5.3 
for r = 1000. 



6.2 Numerical works 



An exhaustive account of the numerical works devoted to the study of FRs is 
practically impossible here, because of space limitations. Therefore, we briefly 
mention a selected group of works, and we concentrate only on two of them. 
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The steady state FR for nonequilibrium systems was introduced and numer- 
ically verified by Evans et al. [?], in a model in which A = Q. After that, 
some numerical tests have been devoted to the A-FR, in order to understand 
the extent to which the Chaotic Hypothesis and the A-FR describe physical 
systems, see e.g. [?,?,?,?,?,?,?,?,?,?,?]. The result is that the A-FR is easily 
verified when A = f2, while difficulties emerge when this is not the case. The 
largest group of tests concerns quantities related in various fashions to the 
entropy production or dissipated energy rates, both in transient and steady 
states, see e.g. Refs. [?,?,?,?,?,?, ?,?,?,?,?]. It has been found that FRs for these 
physical observables are ubiquitously verified, in models of nonequilibrium flu- 
ids. 



6.2.1 The nonequilbrium FPU chain 

Lepri et al. [?] modified the Fermi-Pasta-Ulam model, imposing nonequilib- 
rium boundary conditions by means of two Nose-Hoover thermostats at dif- 
ferent temperatures [?]. This work constitutes a numerical investigation of a 
steady state FR, meant to test the physical applicability of the relation in a 
model substantially different from the original one, i.e. in a solid rather than 
in a fluid. The test of [?] concerned the fluctuations of the heat flux, which 
verified the FR, supporting the idea that such relations do have a quite wide 
range of applicability. 

The model studied in Ref. [?] consists of N anharmonic oscillators of mass 
m and positions Xj, j = 1, ...,iV, whose first and last oscillators (j = I, N) 
interact with the left (£) and the right (r) thermostats, respectively, and with 
still walls, while all oscillators interact with their nearest neighbours through 
the potential: 

V(q) = £+fi£, (6.32) 

where qj = Xj —ja is the displacement of the j-th oscillator from its equilibrium 
position, and a is the equilibrium distance between two nearest neighbours. 
The equations of motion take the form 



d 2 

m ~d~P qi = F ^ qi ~ qi ~^ ~ F ( qi+1 ~ ^ ' for i = 2 ' N ~ 1 ( 6 ' 33 ) 

d 2 , . . . dqw 

m ^2 < i N = p y < i N ~~ ~ F (<^v+i - Qn) - Cr-jr, 
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where go = Qn+i = 0, F = —dV/dz, 



and 6 r , 9i are relaxation times which determine the efficiency of the ther- 
mostats. In the case that T r ^ Tp, Eqs. (6.33,6.34) define the nonequilibrium 
FPU-/? model, which is time reversal invariant, with time reversal operation 
defined by I(q,p, C) = (q, ~P, —()■ The system is also dissipative, and the time 
average of the phase space contraction rate, (£ r + Q), is positive. 

The authors argue that the heat flux J can be identified, in this case, with the 
flux of potential energy. Then, they find that the average fluxes at the left, 
J Li and right, Jr, ends of the chain are given by 

Jl,r = -{<Zl,r)T l , r , (6.35) 

where ((l,r) is the mean value of the corresponding effective momentum of 
the thermostat. By subtracting from one another the fluxes in Eq. (6.35) and 
using the fact Jl = —Jr = J, on average, in the steady state, one obtains 

(A) = (Cl> + <C*> = (J) (-r - y l ) (6 ' 36) 

This relation is analogous to the one for the global entropy production as 
obtained from linear response, but while it holds for the averages, the instan- 
taneos values and the fluctuations of A are not simply proportional to those 
of J. In Ref.[?], the steady state FR for J is tested and found to hold, even 
though the model does not enjoy normal energy transport, in the large N 
limit. This is not a contradiciton in itself, although the validity of the FR, 
close to equilibrium, implies the validity of the Green-Kubo relations (5.61). 
The reason is that the nonequilibrium FPU chain at finite N, enjoys normal 
transport. The anomalous behaviour is reflected only in the divergence of the 
heat conductivity with growing N. 

6.2.2 Granular materials 

Some difficulties are encountered in experimental or numerical studies of the 
FR. An example from heated granular gases is discussed here. The theoretical 
analysis correctly predicts the asymptotic (large deviations, t — > oo) behavior 
of the fluctuations of the work done on the gas, but measurements done at 
finite time lead to contrasting conclusions [?,?]. 

As already discussed in Sect. 4.3 and detailed in the Appendix A, a stan- 
dard way of modeling a granular gas is to consider a set of N hard-spheres 
undergoing inelastic collisions, in which a fraction (1 — r 2 ) of the relative 
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kinetic energy is dissipated. The restitution coefficient r lies between and 
1, where 1 corresponds to elastic collisions. The inelastic collision rule (A.l) 
breaks microscopic reversibility, i.e. for any given trajectory in phase space, 
the time-reversed one is not always physically realizable. One can write an 
energy balance equation for the total kinetic energy E(t) = J2i | v 7\ which 
varies according to 

AE = E(t) - E(0) = W(t) - D(t) (6.37) 

where W(t) is the energy injected by an external driving mechanism, while 
D(t) > is the energy irreversibly dissipated by the inelastic collisions. The 
average variation rate of D can be estimated as the collision rate times the 
energy dissipated through a collision, 

^> = -^<|vi2-*r| s > (6.38) 

where I is the mean free path, cr is the unit vector joining the centers of the 
colliding particles and vi 2 is their relative velocity. The mean kinetic energy 
per particle provides a typical energy scale, also termed granular temperature, 
and it is defined as 

T g = {v1)/d = (3-\ (6.39) 

where d is the spatial dimension. A typical heating mechanism is provided by 
Eq. (A. 2). We discuss here the monodisperse case which achieves a statistically 
stationary state, thanks to the injection of energy by means of independent 
random forces acting on each individual particle. This heating mechanism is 
easier to be handled mathematically and leads to a uniform stationary state. 
The work provided by the external source reads 

W(t) = J2 fdr^r)-^) (6.40) 
• Jo 

Given that (W)/t = 2dT (where T is a parameter of the model, see Appendix 
A), the typical energy scale is set by Eq. (6.47). Following a procedure simi- 
lar to that of Section 6.1.1, we compute the large deviation function for the 
injected work W. 

We begin introducing a phase space density p(P, W, t) that counts the number 
of systems in state P (the iV-velocities phase space point) which, in the time 
window [0,t], accumulated a total work W(t) = W. A generalized Liouville 
equation can be written for p, in which the Liouville operator Cw can be split 
into a W conserving part, £ co ii, and a part accounting for changes in W under 
the effect of the external injection mechanism £ in j: 

d tP = C W (P, W)p = £ inj (P, W)p + £ coll (P)p (6.41) 
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It is convenient to introduce the Laplace transform of p, 

p(P,X,t) = J dWe- xw p(P,W,t), (6.42) 

and rewrite the Liouville equation in terms of p, 

d t p = C W {P, \)p = £ inj (P, \)p + £ co ii(P)p (6.43) 

The largest eigenvalue p(X) of £^(A) governs the asymptotic behavior of p, 

p(P, A, t) ~ C(A)e" (A) *p(P, A) (6.44) 

where p(P, A) is the (right) eigenvector of £w/(P, A), associated with p(\), and 
C(A) is the projection of the initial state on this eigenvector. It is then possible 
to project on the single-particle distribution /^(v, A,t) = / dP N-ip(P , A, t). 
We arrive at 

d t f w {y, A, t) = TA V / (1) + 2Arv • v/ (1) + r(AV - d\)f (1) + Coll. (6.45) 

where in the rhs of (6.45) "Coll" is a shorthand for the collision operator 
which, resorting to the molecular chaos hypothesis, reads 

Co\l = U dv 2 d CT (v 12 . CT ) (\fM( v l,\)fM( v l\)-fW( Vl ,\)fU( V2 ,\)), 
I Jvi2-o->o \r z J 

(6.46) 

where v* and are the pre-collisional velocities, defined in the Appendix A. 
The steady velocity pdf equation (Boltzmann equation) is recovered at A = 0. 
The process encoded in (6.45) can be read off as the original granular gas 
dynamics in which additional particles are created when A > or annihilated 
when A < 0, at a velocity dependent rate \v 2 . The largest eigenvalue of £w(A), 
/i(A) is then interpreted as the population growth rate. This remark was nu- 
merically exploited, for somewhat different systems in [?]. The splitting of 
as a product of independent one particle distributions is indeed a kind of 
molecular chaos hypothesis, for the system with particle non-conserving ficti- 
tious dynamics. The Boltzmann equation toolbox offers many ways to deduce 
an expression for /i(A). The simplest approximation is to project /^^(v,A) 
onto a Gaussian with a A-dependent variance, denoted as T(A), as explained 
in [?]. 

Working in terms of rescaled quantities, with the granular temperature pre- 
cisely given by 

/ 2dfly5F y 

19 {(i-r*)n d ) ' {bA1) 

with Vt d = 2ix d l 2 /T(d/2), and performing the following substitutions 

p - P-^ , A - AT, (6.48) 
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Fig. 17. Plot of the Cramer function for the injected power 
ir(w) = lim^oo j log f(t, wt), where f(t,W) is the pdf of 
W at time t. 

one has: 

MA) = -A + i^A 2 (6.49) 

for the dimensionless quantities, where \Jt(\) sets the typical velocity scale for 
trajectories characterized by A. At large values of A, corresponding to values of 
W small with respect to (W), we expect that T(A) <^ T g and indeed ~ | 
as A — > +00 [?,?]. This can be further refined to obtain the behavior of /i(A) 
at A — > +00, 

//(A) ~ -A 1/4 . (6.50) 
Besides, //(A) possesses a cut in the A-plane at A c = — 3/2 8//3 , such that, as 
A — ► A+, 

/i(A) = 3/2 2/3 - 3 3 ' 2 2 1/6 y/\-\ c + 0(X - A c ) (6.51) 

The presence of this cut is responsible for the exponential decay of the pdf 
of W at large values of W. However, the non-analytic behavior at A — > +00 
leads to a non-analytic behavior as w = W/t — > + , 

7r(w — > + ) ~ — w^ 1 / 3 , 7r(u; — > (iu)) ~ — (to— 1) 2 /2 , 7r(iu — > 00) ~ — w . 

(6.52) 

Simulations of the granular gas heated with the stochastic thermostat [?,?] 
confirm the above results and thus the validity of these approximations. The 
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Fig. 18. Plot of ir(w,t) - ir(-w,t) for 
t = 1, 2 and 3 mean free times (mft). 
The inset shows the probability den- 
sity function of w(t) for the same 
times. 



Fig. 19. Plot of the third cumulant of 
W divided by time. The asymptotic 
regime is reached after fifty mft. 



total work W(t) provided by the random forces over [0, t] is of course, on aver- 
age, a positive quantity, but at finite times there exist phase space trajectories 
which yield a negative W. However, one of the key hypotheses underlying the 
Fluctuation Relation is that the dynamics features at least a weak form of 
time reversibility, for which trajectories (or ensembles of trajectories) possess 
time reversed counterparts (however unlikely). In our granular gas, dissipative 
collisions prevent time reversed trajectories to be physically acceptable tra- 
jectories at all. It should therefore be no surprise that no specific fluctuation 
relation holds in our case. This is confirmed by the explicit calculations pre- 
sented above, that show no specific symmetry property of the injected power 
large deviation function. In spite of this, it may be instructive to plot w vs. 
| In p^l\^ at possibly large times, since this is exactly n(w) — ir(—w), being 

n(w,t) = j In P(wt,t), in the infinite time limit. This is shown in figure 18: 
one actually observes a straight line with slope (3 g , while the analytic results 
suggest the absence of such a straight line, even for values of w not too far 
from its average. In the first place, a numerical simulation is always carried 
out for finite times, and thus one measures n{w,t) rather than its t — > oo 
limit, ir(w). Though ir(w,t) deviates from a quadratic form, which would cor- 
respond to Gaussian P(W,t), this is no proof that the asymptotic regime has 
been reached. For that matter it is instructive to investigate the behavior of 
the third cumulant (W 3 ) jt as a function of time, presented in figure 19. The 
conclusion is that the third cumulant reaches its asymptotic value, consistent 
with the analytic expression, at times a few tens as large as those for which 
negative values of w = W/t can be measured, as shown in figure 18. A simi- 
lar plot of the fourth cumulant would signal that the asymptotic regime has 
not been reached over the chosen time window. What one actually observes is 
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simply the remnant of a short time quadratic behavior for ir(w). This is also 
consistent with the quadratic approximation for /x(A), which would indeed im- 
ply ir(w) — 7r(— w) = j3giv, after restoring the appropriate physical scales as in 
(6.48). 



6.3 Experimental works 

Experimental tests of FRs are usually rather delicate, because large fluctua- 
tions are not directly observable in macroscopic systems. Therefore, one must 
either rely on the validity of local versions of the FRs, or consider small sys- 
tems, like micro-biological systems or nanotechnological devices. Some exper- 
imental works on the FRs, and on similar relations are the following: 

• Ciliberto and Laroche's experiment [?], for the temperature fluctuations in 
a fluid undergoing Rayleigh-Benard convection. A linear law was observed, 
but with a different (perhaps not asymptotic) slope. 

• Wang et al. experiments, for the transient and steady state fluctuations 
of work done on a colloidal particle, dragged through water by means of 
an optical trap, [?,?]. These experiments concerned nanoscale systems and 
motivated Ref.[?] 

• Feitosa and Menon's experiment on a mechanically driven inelastic granular 
gas in a fluidized steady state [?]. They claimed a verification of a local 
version of FR, but their analysis has been criticized (cf. Section 6.3.1). 

• Gamier and Ciliberto's experiment on the fluctuations of the dissipated 
power of an electric dipole [?]. They considered the work and heat fluctu- 
ations, both related with the fluctuations of the power dissipated by the 
resistor, and partly verified the Van Zon - Cohen scenario. 

• Shang et al. experiment on the fluctuations of a local entropy production 
in turbulent thermal convection [?] . They considered a cylindrical cell filled 
with water of aspect ratio one, and verified the steady stat FR. 

• Ciliberto et al. experiment on turbulent flows, verified the local version of 
the FR, proposed in [?,?] 

• Douarche et al. experiment on the steady state and transient work fluctua- 
tions of a damped harmonic oscillator, kept out of equilibrium by an exter- 
nal force [?]. The transient FR was confirmed for any averaging time of the 
work. The steady-state version was observed to converge to the asymptotic 
behaviour. 

• Tietz et al. experiment on the extropy production in a single two-level sys- 
tem, a defect center in natural Ila-type diamond [?]. 

It must be noted that almost all of these experiments afford verifications of 
the FRs only to a certain degree, because various parameters of the relevant 
theories are not accessible or controllable in them. Some authors even argue 
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that a direct verification of the (steady state) FRs may be practically impos- 
sible [?]. This opinion is likely too extreme, but the difficulty so far, remains. 
Therefore, the observation of any approximately linear arrangement of data, 
with any slope, is often taken as sufficient evidence for the validity of the 
steady state relation, even if obtained for relatively short averaging times. 
Easier is the case of the transient relations. Because these relations are alge- 
braic "identities", which hold under almost no conditions, one may find odd 
that they are tested all, but there are at least two reasons for doing it. The 
first is to verify the relevance of the models for which these relations have been 
derived, to the physical reality. Indeed, those models have been devised and 
proved to be succesfull for certain purposes which, in general, are not those of 
the FRs, as recalled in Subsection 5.2. The second reason is that one can still 
rely on a few quantitative theoretical results, for the interpretation of certain 
nonequilibrium phenomena (protein stretching experiments, etc.). 

Despite the difficulty in gathering the necessary statistics, the transient rela- 
tions offer some of the few parameter-free quantitative predictions, which may 
be used to infer equilibrium properties of certain systems, from nonequilibrium 
experiments. The Jarzynski and Crooks relations, in particular, have been 
tested in a good number of experiments including molecular and biophysical 
experiments. The reason is that this equality can be used to estimate the equi- 
librium free energy out of measurements of dissipated work in nonequilibrium 
processes. This is particularly useful in systems for which no other method 
to estimate the free energy exists. Douarche et al. experimentally confirmed 
both in [?] . An experiment for the colloidal particle in a time- dependent non- 
harmonic potential was reported by Blickle et al. [?]. The Jarzynski equality 
was first confirmed in 2002 by Liphardt et al. in measurements of the dis- 
sipated work in the folding-unfolding process of a single molecule of RNA 
[?]. Collin et al. experimentally confirmed the Crooks fluctuation relation by 
pulling an RNA hairpin [?]. As discussed in detail in 6.3.2, using optical tweez- 
ers they measured the fluctuations of the dissipative work during the unfolding 
and refolding of a small RNA molecule. Their measurements confirmed the 
Crooks relation near and far from equilibrium. They also estimated the free 
energy from the nonequilibrium measurements. The nonequilibrium steady- 
state equality of Hatano and Sasa [?] has been verified by Trepagnier et al. 
[?]. A detailed discussion of these experiments can be found in the review 
papers [?] and [?]. 

6. 3. 1 Experiments with granular gases 

Recently an experiment has been performed by Menon and Feitosa [?,?] using 
a granular gas shaken in a container at high frequency. The setup consisted 
of a 2D box containing N identical glass beads, vibrated at frequency / and 
amplitude A. The authors observed the kinetic energy variations AE T , over 
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time windows of duration r, in a central sub-region of the system characterized 
by an almost homogeneous temperature and density. They subdivided this 
variation into two contributions: 



AE T = W T - D T , (6.53) 

where D T is the energy dissipated in inelastic collisions and W T is the energy 
flux through the boundaries, due to the kinetic energy transported by incoming 
and outgoing particles. The authors of the experiment have conjectured that 
W T , being a measure of injected power in the sub-system, can be related to 
the entropy flow or the entropy produced by the thermostat constituted by 
the rest of the gas (which is equal to the internal entropy production in the 
steady state). They have measured its pdf f(W T ) and found that 

ln^^=(3W T (6.54) 

with (3 7^ 1/Tg. By lack of a reasonable explanation for the value of (3, the 
authors have concluded to have experimentally verified the FR with an "effec- 
tive temperature" T e ff = 1/ {3, suggesting its use as a possible non-equilibrium 
generalization of the usual granular temperature. The same results have been 
found in MD simulations of inelastic hard disks with a similar setup, see Fig- 
ure 20. There is a major objection to this reasoning: in the limit of zero inelas- 
ticity (i.e. in the case of ideal elastic grains) the pdf f(W T ) becomes symmetric 
with respect to the average injected power through the borders of the central 
region, which is 0, so that (3 — > and the effective temperature would diverge 
instead of coinciding with the equilibrium temperature. There is also a subtler 
problem in the interpretation of this experiment: from Equation (6.53), it can 
be argued that the large deviation function of f(W T ) equals the large deviation 
function of f(D T ). Recall that f(W T ) ~ exp{rn(W r /r)) when r — > oo, and 
that 7r(g) is the large deviation function of f(W T ), with q = W t /t. Since D T 
is always positive, it follows that the relation (6.54) cannot hold for r — > oo. 

A different explanation has been proposed in [?], which does not involve the 
FR but rather imputes the observed results to effects of finite time and poor 
statistics due to the limits of the measurement procedure. It appears that the 
injected power measured in the experiment can be written as 



where n_ (resp. n + ) is the number of particles leaving (resp. entering) the sub- 
region during the time r (with frequency u), and vf_ (vf + ) are the squared 
moduli of their velocities. In order to analyze the statistics of W T we take n_ 
and n + as Poisson-distributed random variables with average ujt, neglecting 
correlations among particles entering or leaving successively the central region. 
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Fig. 20. a) pdfs of injected power f q (q T ) from MD simulations for different values 
of r = (1,2,4,8,16,32) x r min with r min = 0.015r 6o:r . Here N = 270 and a = 0.9. 
The distributions are shifted vertically for clarity. The dashed lines put in evidence 
the exponential tails of the pdf at r = r m j„. b) plot of (1 / t) log( f q (q T ) / f q (—q T )) 
vs. q T from MD simulations (same parameters as above) at large values of r. The 
solid curve is a linear fit (with slope f3 e ff) of the data at r = 128r m j n . The dashed 
line has a slope f3 gran = l/T gran 

As supported by the direct observation of the simulation [?], the velocities v i+ 
and Vj_ are assumed to originate from two distinct populations with different 
temperatures T + and T_ respectively. Indeed, compared with the population 
entering the central region, the particles that leave it have suffered on average 
more inelastic collisions, so that T_ < T + . Finally Gaussian velocity pdfs 21 
are assumed. This allows one to calculate the generating function of f(W T ), 
obtaining g(z) = exp(r/i(z)) for any r, with 

fx(z) =u(-2 + (l- T + z)- D / 2 + (1 + T_z)- D l 2 ) , (6.56) 

which also automatically coincides with the large deviation function of g(z). 
We recall that the two large deviation functions fi(z) and n(q) are related by 
a Legendre transform. A FR with a slope (3 implies that /i(z) = — z) and 
this relation is not fulfilled by Eq. (6.56). It has, however, been observed [?] 
that ir(q) — n(— q) 27r'(0)g + o(q 3 ) at small values of q. This means that the 
linear relation (6.54) with f3 e ff = 2n'(0) can be observed if the range of W T 
is small, which is usually the case, since in experiments and simulations the 
statistics of negative events is very poor. From equation (6.56) a formula for 
the slope (3 follows: 

= 2^7^ (6 - 57) 



21 while non-Gaussian tails are quite common in granular gases, it has been checked 
that they play a negligible role here 
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with 7 = T + /T_ and 5 = 2/(2 + d). When 7 = 1 (i.e. when the gas is elastic) 
Peff — 0. This formula is in good agreement with the slope observed in the 
simulations and in the experiment. 

The fact that expression (6.57) is in good quantitative agreement with the 
experiment is consistent with the observation of negative events, i.e. not too 
large r. We can thus argue that the experiment and the simulations have been 
perforemd over times large enough to test the validity of formula (6.57), but 
not so large that correlations may be disregarded. 

6.3.2 Applications of the Jarzynski relation to biophysical systems 

The second principle of thermodynamics implies that the free energy difference 
F(B) — F(A) between two equilibrium states A and B is smaller or equal than 
the work W T done by the external force over the system during the A — > B 
transformation taking a time r: 

W T > AF = F(B) - F(A). (6.58) 

The equal sign applies only to infinitely slow transformations, i.e. r — > 00. 
For any finite r, even averaging over many realizations, say M, of the same 
experiment A — > B, the measured (W T ) = Y^iL\ Wr,i is bound by the second 
principle to be larger than AF. 

The Jarzynski equality (5.62) allows to measure AF by means of non-adiabatic 
transformations A — > B, provided that the average (W T ) is replaced by a 
weighted average (W T )j, i.e. the equal sign is always true in AF = (W T )j 
with 

(W T )j = -/?- 1 ln(exp(-/3^ T )) » -/TMn 



As noticed in Section 5.4.3, this argument reverses the link between equi- 
librium and non-equilibrium phenomena implied by the classical FDR. For 
instance, Green-Kubo formulas give a practical recipe to calculate transport 
coefficients from correlation functions in the unperturbed system, i.e. they ex- 
tract non-equilibrium properties from equilibrium ones. On the contrary, in 
the case of Eq. (6.59), an equilibrium property, AF, is obtained by means of 
non-equilibrium measurements. This is particularly useful in biology, where 
the reconstruction of the free-energy landscape of (large) complex molecules, 
such as proteins is crucial for determining folding pathways, the topology of 
the folded state, and the biological utility of the protein. The speed of a fair 
realization of reversibility along a reaction coordinate is determined by the re- 
laxation time of the protein, which can be very long: therefore a naive estimate 



M 



_£exp(-/W T>i ) 



i=i 



(6.59) 
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of (W T ) would require an exceedingly large r. Before the Jarzynski relation, 
the only known correction to the rough estimate (W T ) was [?] 

AF « AF FDR = (W T ) - (3a 2 /2, (6.60) 

with a 2 the variance of W T , which is valid only near the reversible path, i.e. 
still for large r. This correction can be obtained from the FDR for Hamiltonian 
systems. A posteriori, from the Jarzynski relation, Eq. (6.60) is easily obtained, 
assuming that the distribution of W T is Gaussian. 

The alternative provided by Eq. (6.59), suggested in [?] and experimentally 
tested in [?] for the first time, consists in performing M realizations of a 
pulling experiment on a single bio-molecule: the external force, provided by 
the cantilever of an Atomic Force Microscopy or by moving the laser trap 
of an optical tweezer (this was done in the real experiment), is applied to 
a terminal of the molecule, through a bead that plays the role of a handle, 
guiding the transformation from a folded A to an unfolded B state in a time 
r. Measures in numerical and real experiments have shown that the weighted 
average (6.59) can be effectively used to have a better estimate of AF with 
respect to AFfdr Eq. (6.60), for almost the whole range of displacements 
between A and B. Actually the applicability of Eq. (6.59) is not trivial, since 
a careful evaluation of all possible errors is required: reducing r allows to 
increase the number of experiments M, but at the same time makes wider 
and wider the distribution of W T and, therefore, more and more uncertain 
the estimate of the exponential average (exp(— f3W T )) through a finite sum. 
However it has been shown [?,?] that a range of r exists where the estimate 
is reliable. Moreover, this procedure has the advantage of providing a direct 
estimate of the statistical error of the measure, which is not possible with a 
small number of measurements and large r. On the other side, when applying a 
similar procedure to large systems, the difficulty arises that sampling negative 
W T requires the number of independent experiments M to grow exponentially 
with the system size [?]. 



7 Large deviations and FR 



In Sections 2, 3 and 4 we discussed the properties of the mean responses, and 
their link with correlation functions. Sections 5 and 6 have been devoted to 
a more detailed statistical description of the probability distribution of time 
averages on certain intervals. Now, we want to treat at a more advanced level 
the statistical description of the time history of the system, as described by 
its observables. 
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7.1 Onsager-Machlup approach to fluctuations of thermodynamic variables 



As far as we know the first attempt in this direction was made by Onsager 
and Machlup, about half a century ago [?,?]. In two influential papers they 
studied the probability of a given succession of nonequilibrium states, of a 
spontaneusly fluctuating thermodynamic system, under the assumption that 
the N variables {a} determining the state are Gaussian stochastic processes. 
Basically, Onsager and Machlup assume that the evolution of {a} is deter- 
mined by a set of linear Langevin equations: 

N da- N 

E R id-JT = ~ H s iJ a i + , (7-1) 

3=1 al 3=1 

where {77} is a white noise vector, i.e. a Gaussian process with < i] k {t) >= 
and < 7)k(t)r)j(t') >= S(t — t')5kj. The symmetric matrices R = {Rij} and 
s = {sij} determine the thermodynamic forces {X} and the entropy S({a}): 

dS N 

X i = = " E S iJ a 3 ■ ( 7 - 2 ) 



In this approximation, one can express the entropy as 

1 

2 



S({a}) = S ~Iy, s iJ a 3 a i > ( 7 - 3 ) 

i,3 



whereas the dissipation function is 



= IVi?„^^, (7.4) 

2 dt dt K J 

and the corresponding entropy functional is 

1> = \'£LijX i X j , (7.5) 

i,3 

where the matrix L is defined by LX = dat/dt i.e. L = R -1 . 22 Because 

of the Onsager reciprocal relations, the matrices L, R and s are symmetric 

(see section 2.4.3), and the Boltzmann principle implies that the invariant 
probability distribution is given by 



Pinv({a}) oc exp [^({a})] oc exp ~ ^ s^a^i 

1 2 i,3 



(7.6) 



22 As stressed by many authors, e.g. ([?]), a thermodynamic description of a system 
requires an answer to the general question "how do you know you have taken enough 
variables, for it to be Markovian? 1 For instance a noisy RC circuit is Markovian in 
the variables (q, q) but not for q (or q) alone. 



122 



where we took ks = 1. The value of c in (7.1) is determined in such a way 
that Eq. (7.6) holds. Above we have used the original notation of the paper 
by Onsager and Machlup. In modern notation one would have 

7 N 

■^ = -5;%^ + ^ k = l,...,N, (7.7) 
at j=1 

where now {fj} is a Gaussian process with < fjk(t) >= and < fjk(t)fjj(t') >= 
CkjS(t — t'). The link with the original notation, is given by B = R _1 s and 
C = R~ 2 . 

Let, for the sake of simplicity, N — 1: 

dot r— ,„ „. 

— = - 7 « + V2c V , (7.8) 
at 

with 7 = s/i2. The conditional probability density for a(ti) = a±, given 
a(to) = ao, is 

Pi(ai,tia ,*o)= y ^=xexp - v * ^ > 7 -9 

^2^(1 - a(r) 2 ) V 2C[1 - a(r) 2 ] / 



where t\ = to + r and 



a(r) = e^ T , C=- = - 

7 s 



Using the Markovian nature of the process, it is easy to determine the prob- 
ability density of a discrete trajectory, a{t\) = ai,a(t2) = a2,...a(t n ) = 
a n ...a(t M ) = a M , where t n — t + nr and a(t ) = a . One gets 

M 

Pm(«(^i) =«!,..., a(t M ) = a M \oio,to) = J[ Pi(a n , t n |a n _i, t n -i) . (7.10) 

n=l 



In the limit of small r, one obtains the rather transparent expression: 
Pi(a n ,t n = t„_i + r|a n _i,£ n _i) = 7y=^ x ex P [~K a n, , (7.11) 



where 

£(o: n , i) TJ^) 
which leads to 



(a n - a n _i) 



+ 7«n 



2 



, with D = C7 = ^ , (7-12) 
R 



Pu{oi{ti) = «i, ...,a(t M ) = "mK^o) =( ^r^: ) x ex P 



1 \ M / 2 



M 



- ^ £(a n , a n _i)r 
(7.13) 
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The conditional probability distribution Pi(atM, ^jw|o;o, to) can be obtained 
from (7.13), integrating over oc\, ct2, cxm-i- Performing the limit r — > 
and M — > oo in such a way that rM = constant — t — to, one obtains 

Pi(a(t),t|a(t ),to) = r (t) Va{t') exp ( - f dt 1 ' £[a(t') , a(t')}\ (7.14) 

Ja(t ) I J<o J 

where the Lagrangian function is 

and the functional integral is defined in the usual way, i.e. 



/ Va(t')X t [{a(t')}} = lim — — / da x / , / ^^[{a^i), {a( 

Ja(to) M->oo \ 47T.L>T / J J J 

(7.16) 

for any functional X t [{a(t')}]. 



The probability density of a path {a(i)} is 

P({a(0},<o < t' < t) ~ expj- jT*dt'/:[a(0,a(0]}- ( 7 - 17 ) 

Noting that 

£[a, a] = j (d + 7 «) 2 = \ (0 + V - (7.18) 
one can recast (7.17) into 

P({a(t')},t <t'<t)~ exp {-I^V(0 + ^) + l[S-(a t ) - 5(a )]} • 

(7.19) 

This result plays a role analogous to the Boltzmann principle in nonequilib- 
rium statistical mechanics because it expresses the probability of a state in 
terms of its entropy. Here the probability of a sequence of states is expressed 
in terms of the entropy and of the dissipation function. 

The most probable value of a(t) is obtained minimizing J t * dt'C[a(t'),a(t')]: 

doc 

— = —7a with a(to) = en® (7.20) 

(JjL 

i.e. a(t) = a(0)e~ 7 ^~ to \ In other words, the most probable value of a(t) 
coincides with the conditional average < a(t)\a(to) >■ 

Analogously, the most probable path starting from a an d ending in a t is 
given by the minimum of J t * dt' C[a(t') , a(t')] with the constraints a(t ) = a 
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and a(t) = a t . The minimum condition corresponds to 



to 



((f) + %jj)dt' 



2%)-%) 



(7.21) 



The extension to iV > 2, does not present particular difficulties. For the case 
described by (7.7), the symmetry of the matrix C allows us to work in the 
diagonal representation of the white noise fj k) i.e. to deal with N independent 
Markov processes. Therefore it suffices to replace the C in (7.15) for N = 1 
with 

£{a, a) = — (a k + Y B k,j a j) A Kk' + S B k',j a j) ( 7 - 22 ) 

4C k,k' V j 7 V j 7 



where A = C 1 . In addition one has 



£(a,flf) = ^(^(ot,o)+^(X)-^ 



(7.23) 



and all the previous results hold for N > 1. 



7.1.1 The non Gaussian case 

The generalization of the above results to the nonlinear case, i.e. 

f k (a) + V2~c Vk k = l,...,N, (7.24) 



da k 



dt 

where {77} is a Gaussian process with (rjk) = and ("r)k(t)Vk'(t')) = 8k,k'8(t—t'), 
is rather simple, at least at a formal level. Instead of (7.22), one obtains 

C(a,a) = — Ysi 61 *- fk) A k,k>(ak' - fv) ■ (7-25) 

4c k,k' \ / v / 

A simple way to derive this result is the following: repeat the argument to 
obtain (7.13) for small r, and perform the path integral. Let us sketch the 
basic idea, for the one variable case: 

da „. . , — 
— = f(a) + V2cv ■ 

Denote a n = a(t + nr) and write the above Langevin equation in its discete 
time approximation: 



a 



n - a n _i = f(a n )r + \plcrw n 
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where {w n } are Gaussian random variables with (w n ) = and (w n w n i) = 5 n ,n'- 
Since the pdf of w n is Gaussian, the generalization of (7.13) merely requires 
that £ in (7.13) be replaced by 



£(a n ,a n _i) = 



4c 



(a n - a n -i) 



/(an) 



The above procedure is heuristic and the result is not completely exact. Nev- 
ertheless it yields the leading term for small values of c. We do not discuss 
here this delicate point, the interested reader can see [?,?]. 



The theory here outlined, for homogenous systems, can be reformulated for 
spatially extended systems, as illustrated in the next subsections. 



7.2 Large deviations in extended nonequilibrium systems 



Various attempts have been made to extend Onsager-Machlup theory [?] to the 
large fluctuations of physical systems in nonequilibrium steady states. Among 
them, the work by Jona-Lasinio and collaborators [?,?], is particularly relevant 
to our discussion. Such approach generalizes those of Derrida et al. [?], and 
in addition it leads to an independent derivation of the FR. The theory of 
[?,?] begins from the assumption that a hydrodynamic-like description of the 
system at hand is possible hence, physically, it can be applied as far from 
equilibrium as the validity of the local thermodynamic equilibrium allows. 23 

The theory leads to the conclusion that the nonequilibrium entropy functional, 
which generalizes the Onsager-Machlup entropy to extended systems, is a non- 
local functional of the thermodynamic variables, hence that correlations are 
present over macroscopic scales. To illustrate these facts, consider stochastic 
models of interacting particles, whose number is locally conserved, in contact 
with particles reservoirs. Assume that these systems admit the hydrodynamic 
description 



dtQ = V 



\d(q)Vq 



V(g) , £? = £?(x,t) , (7.26) 



where g is the vector of macroscopic observables, x is the macroscopic space 
variable, t is the macroscopic time, D is the diffusion matrix. Equation (7.26) 
is analogous, in the spatially extended case, to Eq.(7.7) without noise. 

The mathematical theory is necessarily developed for very idealized models, 



23 This, of course, includes a very wide range of phenomena, well beyond the linear 
regime, which has quite wide applicability by itself. 
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such as the simple exclusion or the zero range stochastic processes. 24 Never- 
theless, the assumptions under which the theory holds are thought to be valid 
much more generally than in these cases, and are the following: 

Assumptions: 1) The mesoscopic evolution is given by a Markov process X t , 
which represents the configuration of the system at time t. The nonequilibrium 
steady state is described by a probability measure Prob over the trajectories of 
X t ; 

2) the macroscopic description is given in terms of fields g which constitute the 
local thermodynamic variables, whose evolution is described by (7.26), which 
has a unique stationary solution g, under the given nonequilibrium boundary 
conditions; 

3) Denoting by I the time inversion operator defined by IX t = X_ t , the proba- 
bility measure Prob*, describing the evolution of the time reversed process X% , 
and Prob are related by 

Prob*(X t * = <M e [hM) = Prob(X t = 0_ t , t G [-f 2 ,-*i]). (7.27) 

Moreover, if L is the generator of X t , the adjoint dynamics is generated by the 
adjoint (with respect to the invariant measure ji) operator L* , which admits 
the adjoint hydrodynamic description 

d t g = V* (g) , (7.28) 



4) The measure Prob admits a large deviation principle describing the fluc- 
tuations of g, i.e. the probability for a large number N of particles that the 
evolution of the random variable g^ deviates from the solution of (7.26), to 
follow a given path g(t), in the interval [U,tf], goes like 



Prob (g N (X N 2 t ) ~ g(t), [t h t f ]) « e 



-N 



S(e(ti)+J[ tj , t/] (e) 



(7.29) 



where d is the spatial dimension, S(g(ti)) is the entropy cost to produce g{U), 
and J is the extra cost required to follow the given path (taking S{g) = 0, J 
vanishes at g = g). 



This machinery leads to the following results: 

• The Onsager-Machlup theory is generalized by the introduction of the "ad- 
joint hydrodynamic" equation (7.28), for the spontaneous fluctuations around 

24 These models are usually one-dimensional. Their hydrodynamic limit consists of 
a scaling of the microscopic space and time variables, r and r, with the macroscopic 
space and time variables given by t = t/N 2 and x = r/N, and the number of 
particles per unit length N tending to infinity. 
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nonequilibrium steady states. Then, assuming that V can be decomposed 

as 

V ^ = \ V ' + A (7.30) 

where A is a vector field orthogonal to the thermodynamic force SS/Sg (the 
functional derivative of the entropy with respect to the state), a temporal 
asymmetry arises in the fluctuation-relaxation paths. Indeed, a spontaneous 
fluctuation out of a nonequilibrium steady state follows a trajectory which 
is the time reversal of the relaxation path, according to the adjoint hydro- 
dynamics, i.e. it solves 

d t g = -V*(g) = -V(q) + 2A , (7.31) 

which is not merely the time reversal of the hydrodynamic equation. Being 
orthogonal to the thermodynamic force, the term that breaks the time sym- 
metry, A, is not the one that contributes to the entropy production. Note 
that Eq. (7.28) describes the adjoint hydrodynamics, while Eq. (7.31) refers 
to the evolution of spontaneous fluctuations. 

A Hamilton- Jacobi type equation is given for the macroscopic entropy S(p). 
Expressing J as 

J[u,t f ](Q)= dtC(g(t),d t Q(t)) (7-32) 
and introducing the Hamiltonian as the Legendre transform of C(g^d t g)^ 



H(Q,Y)= f m v ytYdx-C(Q,Z)} , 



the Hamilton- Jacobi type equation associated with the relation between S 
and J is 

«(e,g)=0, (7-33) 

where S(g) = inf^ J[_oo,o](f?) is computed over all trajectories g(t) connecting 
g to q. Then, the steady state satisfies H(g, 0) = 0. 

• An H-theorem is given for S: 

±S<0. (7.34) 

• A nonequilibrium fluctuation dissipation relation holds: 

V(g)+V*(g)=V-(x(Q)V 5 -^J . (7.35) 

These results have been later generalized to the case of systems subjected to 
external bulk forces, like electric fields [?]. 
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7.2.1 Temporal asymmetries in deterministic systems 

The question arises as to which aspects of the large deviation theory described 
above may be verified experimentally, or numerically tested in models other 
than the lattice gases for which it has been rigorously estabilished. For in- 
stance, one usually assumes that the stochastic description is a reduced rep- 
resentation of some microscopic reversible dynamics, and should be recovered 
from that in some limit. However, various difficulties are to be faced, in or- 
der to answer that question. For instance, the dynamics of the Lorentz gas 
are proven equivalent to Markov processes, obtained by coarse graining with 
Markov partitions the relevant phase space [?] . On the other hand, the kind of 
stochastic process that one obtains depends on the particular form of grain- 
ing, and concerns the phase space instead of the real space. Furthermore, it 
is not always possible to point out without ambiguities which quantities of 
the stochastic systems correspond to given quantities of the deterministic sys- 
tems. Therefore, the identification of the deterministic dynamics which are 
consistent with a given stochastic process or, conversely, the identification 
of the stochastic processes which preserve the observable properties of given 
microscopic dynamics, is a rather difficult task, in general. 

This, on the one hand, indicates that a direct comparison between the predic- 
tions of Refs. [?,?,?] and the fluctuations of deterministic particle systems may 
be rather problematic, if not impossible, although desired [?]. At the same 
time, the behaviour of a macroscopic system cannot depend on such subtle 
and subjective issues like the form of the partitioning of the phase space; thus 
a test on deterministic systems of some aspect of the stochastic theory should 
be possible, in principle at least. Therefore, in Refs. [?,?,?] the prediction of 
the temporal asymmetries of fluctuations is tested, because the differences be- 
tween hydrodynamics and adjoint hydrodynamics are largely responsible for 
the other theoretical predictions, and because such asymmetries look amenable 
to direct test. It would be interesting to test, on determinisitic systems, other 
features of the stochastic theory. 

The origin of the temporal asymmetry can be easily understood as follows. 
Consider the macroscopic deterministic dynamics described by 

j t Q = V{e) , (7.36) 

on M C IR n , where V is a vector field with a globally attracting fixed point 
q G M.. The n components of g may represent the values taken by a scalar 
thermodynamic observable on the n different sites of a spatially discrete sys- 
tem. Let the local mesoscopic dynamics be a perturbation of Eq.(7.36), with a 
Gaussian noise of covariance (£j (t) £j (t')) = K^b (t — t') and mean = 0, 
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where K is a symmetric, positive definite matrix: 25 

±Q = V(e)+t. (7.37) 

This allows different evolutions between one initial state Qi = g (t«) and one 
later state gf = g(tf). The different paths connecting g i to gj occur with 
different probabilities and Eq.(7.36) can be obtained from the maximization 
of probabilities of the form P oc exp(— t ^(g)), which depend on g i: gf and 

on the path connecting them: 

where the scalar product is defined by (x, y) = x T K.~ 1 y, and the superscript 
T indicates transposition. Therefore, Eq.(7.37) is analagous to Eq.(7.7), and 
Eq.(7.38) corresponds to Eq.(7.22), with K 1 in place of A/2c. Now, decom- 
pose the vector field V as 

V(g) = -^KV e V(g)+A(g), with {KV e V,A) = 0, (7-39) 

where V g indicates differentiation with respect to the components of g, and 
let g be a minimum of V, with V(g) = 0, separating dissipative contributions 
to T> from non-dissipative ones, as common in diffusion processes described by 
finite dimensional Langevin equations [?]. Substituting (7.39) in (7.38), one 
obtains 

2 %M M = f {j t ^\^' v ~ A - J t ^ I KV « V ' " A ) dt < 7 - 40 ' 

which is minimized by the relaxational path converging to g and obeying 

± e =-\KV 8 V(Q)+A(Q) , (7.41) 

i.e. obeying (7.36). However, the integrand of (7.40) is a quadratic form and 
has a second minimizing path, which is revealed by an integration by parts. 
This yields: 



+2[V (Bf) -V (7.42) 



25 Note that here we have adopted the convention of Ref.[?] for K, which misses a 
factor 2 with respect to more standard notation used in Section 7.1. 
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whose second term has no variation, once the inital and final states are fixed. 
Therefore, the second possible kind of evolution for g corresponds to the fluc- 
tuations away from g, which obey 



d 



V*(g) = ±KV s V + A(g) 



-V + 2A. 



(7.43) 




The qualitative properties of the deterministic dynamics do not depend on 
A, as the time derivative of the Lyapunov function V does not depend on A. 
Curiously, the asymmetry of the fluctuation paths depends only on this non 
dissipative term. 

In the hydrodynamic limit, V becomes the elliptic differential operator of 
Eqs. (7.26,7.30), where K turns into V-%(^)V, V e into the functional derivative 
S/Sg and V(g) into S(g). In the theory developed by Onsager and Machlup, 
A = because only the small fluctuations were considered, and the linear 
response regime was assumed. 

The above suggests that sufficiently chaotic systems of interacting particles 
should typically have asymmetric fluctuation paths. This has been indeed con- 
firmed in [?,?] for the nonequilibrium FPU model, as well as for the shearing 
system of Eq.(5.2). In Ref.[?] it was then explained that the current fluctu- 
ations of the many particles nonequilibrium Lorentz gas, studied in [?], had 
to be symmetric, as observed, because of the lack of interactions among those 
particles. It remains an open question to see which kinds of interactions lead 
to symmetric and which to asymmetric nonequilibrium fluctuation paths. 

To properly deal with deterministic systems of finitely many particles, Refs. [?,?,?] 
introduced various notions of fluctuation-relaxation paths, together with vari- 
ous criteria to assess their asymmetry. In the following subsection, we consider 
only one of these notions, for the local heat flux of the nonequilibrium FPU 
model. 



7.2.2 Heat flux fluctuation-relaxation paths in the FPU model 

An observable X : M — > IR, for a system made of a finite number of particles, 
looks very noisy, in general. Therefore, given an initial condition T in the 
steady state, we search for the most likely path that starts at X ti = X, reaches 
a certain fluctuation value T(X) at time t, and later returns to X = X tf . 
By path we mean the trajectory segment {Xf +T , r e [— t ,t ]} where, for 
simplicity, X t denotes X(S l T), and X is the corresponding time average of 
X. The time r is a positive constant, that needs to be identified case by 
case, and represents the typical fluctuation time. This notion may look odd, 
since a part of a given fluctuation-relaxation path is sampled more than once 
(tipically twice), but is appropriate to study the symmetry properties of paths, 
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because it does not alter their symmetry, and does not neglect any of them. 
Furthemore, the results obtained so far are robust against variations of this 
definition [?,?]. 

Given n paths, they can be arranged to produce a two dimensional histogram, 
by partitioning the rectangle [— r ,r ] x [min r s X^ s \ max T S X^ s )] with rectan- 
gular bins, and evaluating the frequency of visitation of each bin. The "crest" 
of the histogram represents the most likely path in the sample, the one which 
should become the unique (determinisitc) path in the large system limit. In 
[?], a number M of tests is performed, each producing a different histogram 
and a different crest, so that the maximum, minimum and average crests can 
be defined as follows. Let t G [— t ,t ] and j = 1, ...,M be the index of the 
crest, then, denoting by O the crest produced in the j-th test, 

i M 

Ca V (t) = (t) (7.44) 



is the average crest; 

is the minimum crest, and 

is the maximum crest. 



C(t) = min CHt) (7.45) 

j=l,...,M 



C(t)=m^ M a(t) (7.46) 



To assess the symmetry properties of a crest C, discretize the time interval 
[0, tq] in b T subintervals, and introduce the asymmetry coefficient as 



2 



(7.47) 



W " X > \ P =^+i p=i j 

where, the normalizing factors are introduced only for convenience. A crest is 
called symmetric if its asymmetry coefficient vanishes. The asymmetry coeffi- 
cients can take positive as well as negative values, and random oscillations of 
a fluctuation path around its symmetric relaxation image result in a vanishing 
asymmetry coefficient. With these definitions, and M = 20, the heat flux in a 
central portion of the chain, of the nonequilibrium FPU model, with N = 150 
oscillators, produces results like 

a c (C) = 0.170 , a c (C av ) = 0.194 , a c (C) = 0.211 

for a large temperature difference between the ends of the chain (T e = 200 
and T r = 20), and for a fluctuation value T three standard deviations higher 
than the mean. Here, the gap between the maximum and minimum crests 
asymmetries can be taken as the numerical uncertainty on the asymmetry 
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Fig. 21. Crest of the heat flux / for an FPU chain with N = 66, Tg, = 70, T r = 20, 
/ ~ 16.2, and T ~ 148. The highest line represents C, the intermediate line repre- 
sents C av , and the lowest line represents C . Each line is the overlap of the four crests 
obtained with M = 39, 59, 79, 99. 

of the crest. The result is that temporally asymmetric fluctuation- relaxation 
paths are found in time reversal invariant dynamics. Figure 21 illustrates these 
facts for a chain with fewer oscillators, for which a relatively large number of 
tests can be performed. In this case, it is interesting to see that the three kinds 
of crests do not appreciably change when the number of tests grows over M = 
20, which is an indication of the accuracy achieved in the construction of the 
crests. In Ref.[?], a justification of the ubiquity of the temporally asymmetric 
fluctuation-relaxation paths, in nonequilibrium particle systems, is given in 
terms of correlation functions. 



7. 3 The additivity principle 

The theory developed in Refs.f?,?] has a nonlocal nature, as easily understood 
in the works of Derrida and collaborators [?,?], who independently worked 
out the explicit solutions of what can now be seen as specific examples of the 
theory of [?,?]. Actually, explicitly computing the large deviation functional 
of the current in systems like the symmetric and asymmetric simple exclusion 
processes, Bodineau and Derrida realized that a certain additivity principle 
describes the corresponding steady states. 

The idea is the following: let a one dimensional system have length L + L' and 
be in contact with two reservoirs of particles at densities g a and Qb- Express 
the probability of the current integrated in a time t, Qt = jt say, as 

Prob L+L dj, Q a , Qb) ~ e-'WO'^^) . (7.48) 
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Then, the additivity principle relates Fl+l> to the large deviation functionals 
of the subsystems of sizes L and V ', by taking 

Prob L+L /(j, g a , g b ) ~ max{Prob L (j, g a , ^)Prob L /(j, g, g b )} . (7.49) 



Fig. 22. Sketch of a one-dimensional system between two reservoirs p a and pi,, which 
is virtually divided into two sub-systems of length L and V respectively. An average 
current j flows through the system (assuming for instance that p a > pb). 

In other words, one assumes that the probablity of transporting j between the 
reservoirs at densities g a and gb, is the maximum over g of the probabilities of 
transporting the same currents between two reservoirs at densities g a and g, 
times the probabilities of transporting it between two reservoirs at densities 
g and g b - Then, in the large system limit, in which boundary contributions 
become negligible, the relevant large deviation functional takes the form 

F L +L'(j, Qa, Qb) = max{F L (j, g a , g) + F L ,(j, g, g b )} . (7.50) 

In the case of nonequilibrium boundary conditions (i.e. g a ^ gb), this results 
in a nonlocal relation for the steady state density profile, as shown in the next 
subsection for an exactly solvable model. Introducing the scaling hypothesis 

F L (j, Qa, Qb) - jrG(Lj, g a , g b ) (7.51) 

and observing that the optimal profile conneting g a to gb is the same for both 
j and — j, in the steady state, Bodineau and Derrida obtain also the validity 
of the FR for the current j , in the form 

fSa Dig) 

G(-j, g a , Qb) = G(j, g a , g b ) - 2j / — — dg (7.52) 

J 8b a(g) 
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where D(g) and a(g), in the large L limit, are defined as follows: let g a = g+Ag 
and gb = g, with small Ag, then {Qt)/t = D(g)Ag/L and (Ql)/t = a(g)/L. 



7. 3. 1 The symmetric simple exclusion process 

The symmetric simple exclusion process affords one of the few nonequilibrium 
systems for which the large deviation function of the density can be computed 
in an explicit way. This model consists of a 1-dimensional lattice with L sites, 
which can be either empty or occupied by one particle. At each time step, of 
length At every particle can jump with equal probability At to the right, if 
the site on the right is empty, or to the left, if the site on the left is empty. At 
the left boundary of the lattice (site 1), particles are injected with probability 
aAt, if 1 is empty, and are removed with probability ^At, if 1 is occupied. 
Similarly, at the right boundary (site L), particles are injected with probability 
5 At and removed with probability (3 At. This is equivalent to have a reservoir of 
particles at density g a = a/(a+ r y) on the left, and one of density gb = 5/(5+/3) 
on the right of the lattice. Therefore, if Ti — 0,1 is the random variable equal 
to when site i is empty, and equal to 1 when it is occupied, one obtains 



^ = «-(a + 7 + l)(ri) + (r 2 ) (7.53) 
d(r t ) 



dt 
d(r L ) 



(r i _ 1 )-2(r i ) + (r i+1 ) , 2<i<L-l (7.54) 
■■(t l ~i)-(S + (3+1)(t l ) + S (7.55) 



dt 

The steady state, which corresponds to vanishing derivatives, takes the form 



(n) = ^ p ;: / .v^ (7 - 56) 

and the current takes the form 

J=(T ,- TW ) (7.57) 

which is proportional to the gradient (g a — g b )/ L, when L ^> 1, g a /a, gb/S. At 
equilibrium, with g a = gb = Q, and in the large L limit, if the lattice has unit 
length, the large deviation functional takes the form 

F{g)= B(g(x),g)dx, with B(g, g) = (1 - g) log - + g\og-. 

Jo 1 — g g 

(7-58) 

The functional is thus a local function of g(x), and is convex. Let us note that 
B(g, g) is nothing but the Cramer's function corresponding to the binomial 
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distribution, see Appendix B. Differently, in the nonequilibrium case, g a ^ Qb, 
one has 



F(g) 



B(g(x),f(x)) +\og 



fix) 

Qb - Qa 



where / is the monotone solution of 

/(I - /)/" 



/ + 



./ 



12 



, f(0)=Q a , f(l)=Qb 



(7.59) 



(7.60) 



This result, which was first obtained in [?] and, later, as a special case of the 
theory of [?], shows that the value of / at position x depends on the profile 
g(y) at all points y, hence that F is non-local. 



8 Conclusions 



In this report we have summarized the history and the state of the art of 
the studies concerning the response of physical systems to external actions. 
This has evidenced how the statistical mechanics community has gradually 
shifted its focus from the investigation of equilibrium and near equilibrium 
phenomena, to strongly nonequilibrium phenomena, which cannot be under- 
stood in terms of thermodynamic quantities. Similarly, the interest has moved 
from the construction of a microscopic interpretation of the macroscopic phe- 
nomena, for which the thermodynamic limit of finite systems is necessary, to 
the study of the properties of mesoscopic and microscpic objects, which can 
be understood as systems of finitely many microscopic components. These 
objects are presently under intense investigation, because they appear to be 
extremely interesting from both fundamental and applied viewpoints. From 
the applied viewpoint, it is important to understand their behaviour, because 
of the emerging nanotechnology, which impacts also on our ability to manipu- 
late biological systems. From the fundamental point of view, it is now obvious 
that they must be described by phenomenological equations which differ from 
those of the macroscopic world. But the classification of the phenomena which 
are possible at the mesoscopic and microscpic level is still to be done, and a 
consistent theory of such phenomena is still lacking. 

Nevertheless, the body of knowledge acquired in the past century, in the con- 
struction of the microscopic theory of the response of macroscopic systems, 
appears to be an ideal springboard to decisively leap into the largely unex- 
plored realm of strongly nonequilibrium systems, and of microscopic objects. 
Indeed, this knowledge has been based on the characterization of the fluc- 
tuations which, although macroscopically not observable, are evident if the 
thermodynamic limit is not taken. This is why we believe that a review of 
the response theory stretching up to present times, with emphasis on non- 
standard issues (granular media, fluids, nano-systems and biological systems), 
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was needed and should be useful in advancing our understanding of the phys- 
ical world. 
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A Appendix: Models of granular gases 

The most common model of fluidized granular matter is the gas of inelastic 
hard spheres in d dimensions (reviews of recent results can be found in [?] 
and [?]), interacting through binary inelastic collisions. Initially the N par- 
ticles are placed in a box of volume V = L d , at random positions and with 
random velocities, typically taken from a Gaussian distribution. Since we dis- 
cuss monodisperse as well as bidisperse systems, we denote by Sj, <J{ and rrii 
respectively the species, the diameter and the mass of particle i. The use of 
a and m without indexes will denote the monodisperse case. When particles 
i and j collide, the instantaneous change of their velocities is given by 

V; = Vi - (1 + nj) I [(v< - Vj) • aijfaj (A.l) 

where G [0, 1] is the restitution coefficient, rrii and m,j are the masses of the 
particles and &ij is the unit vector joining the centers of the particles. When 
Tij = 1 the gas is elastic and no energy is dissipated in the collisions. In all 
other cases the collisions are dissipative. Different kinds of experimental setups 
can be reproduced by this model, provided that a suitable driving mechanism 
is added. A widely accepted model for the investigation of strongly fluidized 
granular gases, reduces the effect of the interaction between the grains and 
the fluidizing agent (e.g. an air flow or random collisions with the vibrating 
plate) to that of a "thermal" bath coupled to every particle. Between collisions, 
the particles are subjected to a random force given by white noise, with the 
possible addition of a viscous term. The equation of motion for a particle is 
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then 

m i^f= F ? l +Vi-l Si Vi (A.2) 

where Ff z is the force due to inelastic collisions, / y Si is the viscosity coefficient 
of species s$ and rji is the Gaussian stochastic force, with {f]i a {t)r]jp{t')) = 
T 2 Si 5ij5 a p5{t — t'), where the Greek indices refer to Cartesian coordinates. The 
granular temperature of species s is given by its mean kinetic energy = 
m s (v 2 ) s /d where () s is an average restricted only to particles of species s. This 
definition is important in view of the lack of energy equipartition observed in 
granular mixtures. 

From the generic equation of motion (A.2), many different models can be 
obtained. When 71 = 72 = 7, I\ = T 2 = T, r±i = ryi = r 22 = r, and all 
the particles are identical, the gas is monodisperse. The "cooling granular 
gas" is recovered when 7 = T = [?]. In such a case the particles follow 
ballistic trajectories until they collide and lose energy. The kinetic energy of the 
particles in their center of mass frame decreases with time, justifying the term 
"cooling". The homogeneous cooling is an idealized situation obtained when 
the positions of the particles are disregarded [?]. This situation is considered 
the analogous of the perfect rarefied gas in the realm of granular matter. For 
this model an equation for the evolution of the single particle velocity pdf 
/(v, £) can be written, in the form [?] 

(d t + v-V)f(v,t) = J\f,f\(v,t), (A.3) 

where, in the Boltzmann-Grad limit, the collision operator J, for hard spheres, 
takes the form: 

J\f,f\(vi,t) = ] - f dv 2 d<r(v 12 .<r) fV( v I»*)/(v5,0-/(vi,*)/(v2,0) • 
i Jv 12 -a->o \r z J 

(A.4) 

In this last expression, the relative velocity v 12 = V! — v 2 has been used, as 
well as the pre-collisional velocities v^Vg which can be obtained from Vi,v 2 
inverting the collision rule (A.l) for particles 1 and 2. 

When r 7^ the effect of external random forces balances the energy dissipated 
in collisions, and a statistically stationary state is reached. Two possibilities 
have been considered in the literature: 

• the heat bath with viscosity [?,?], i.e. 7 7^ 0: in this "bath temper- 

ature" can be defined as = T 2 /27. This corresponds to the temperature 
of a gas obeying equation (A.2) with elastic collisions or without collisions. 
The same temperature can be observed if the viscosity is very high, i.e. when 
7 ^> 1/t c where r c is the mean free time between collisions; when 7 <^ l/r c 
and r < 1 the gas still reaches a stationary regime, but its granular tem- 
perature is in general smaller than T5 and, therefore, the system is out of 
equilibrium [?]; 
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• the heat bath without viscosity [?,?,?], i.e. 7 = 0; in this case to obtain 
the correct elastic limit one must reduce the driving intensity T ~ 1 — r 2 
as r — > 1, so that the average kinetic energy per particle and per degree of 
freedom T g does not diverge. 

These two models show a rich range of phenomena, that are usually observed 
in driven granular gases. The statistical properties of the stationary state ob- 
tained by those models are different from those of an elastic gas in contact with 
a thermal bath: the most important difference is that the velocity distribution 
is non-Gaussian with enhanced high-energy tails [?]. The other typical fea- 
ture is that the inelastic collisions reduce the relative velocity of particles and 
make re-collisions more likely: this is a source of correlations which emerges 
in the form of density clusters and velocity parallelization (vortices and other 
structures [?,?,?]). The hydrodynamic transport coefficients for these models 
have been calculated from the Chapman-Enskog approximated solution of the 
Boltzmann equation in [?], while an analytical study of the Einstein relation 
can be found in [?]. 

Other models can be derived from the previous ones. A useful approximation is 
the so-called Direct Simulation Monte Carlo, or DSMC [?,?,?], which consists 
in disregarding the relative position of particles in order to drastically reduce 
the probability of a re-collision: this is usually considered to be equivalent to 
the Molecular Chaos assumption in the N — > 00 limit . Here, we consider the 
uniform gas. This model is nonetheless useful to test also spatial effects, see for 
example [?,?]. In this case the collisions occur with a probability which is pro- 
portional to the relative velocity of the particles, in order to be consistent with 
the kernel of the collision integral of the Boltzmann equation (A. 4). A further 
simplification is operated in the so-called Inelastic Maxwell Models (see [?,?] 
and references therein). These models are gases of inelastic particles without 
positions, where collisions occur with a constant probability, i.e. not depen- 
dent upon the relative velocity. They are inspired by the so-called Maxwell 
Molecules, an elastic kinetic model having the same property due to the partic- 
ular inter-particle (soft core) potential. Inelastic Maxwell Models have a very 
simple Boltzmann equation that can be analytically solved in the one dimen- 
sional case [?,?]. Other properties can be obtained in an analytical form, for 
example it is possible to demonstrate a general relation between the response 
R(t) of a particle to the sudden perturbation of its velocity at time 0, with a 
very large set of correlation functions, including the self-correlation [?,?]: 



R(t) = C f (t) 



(v(0)f[v(0)}) 



= exp 



( 



r(r + 1) 



4 



t 



) 



(A.5) 



with any generic function / of the initial velocity value. 
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B Appendix: Large Deviations in a nutshell 



For the sake of self-consistency, we briefly discuss the basic aspects of the 
Large Deviations theory. Roughly speaking, one can say that the Large Devi- 
ations theory is a generalization of the two most important limit theorems of 
probability theory, i.e. the law of large numbers, and the central limit theo- 
rem [?,?]. 

Consider a simple example: a sequence of independent tosses of an unfair coin. 
The possible outcomes are head (+1) or tail (—1). Denote the possible result 
of the n-th toss by x n , where head has probability a, and tail has probability 
1 — a. Let Y N be the mean value after N tosses, 

1 N 

Vv = -]>>„. (B.l) 

JV n=l 

If N ^> 1, a straightforward application of the central limit theorem gives 

N(Y-(Y)) 2 

Prob(Y <Y N <Y + dY)~ P N (Y)dY ~ e ^ — dY , (B.2) 

where (Y) = 2a — l,a 2 = 4a(l — a), Pn(Y) is the pdf of the random variable 
(B.l). Since Yn lies between —1 and 1, it is easy to realize that (B.2) is 
accurate only for small deviations of Y^ from the mean (namely \Y^ — (Y)\ < 

o(i/Vn)). 

A natural way to introduce the large deviations and show their deep relation 
with the concept of entropy is to perform a combinatorial computation. The 
number of ways in which K heads occur in A" tosses is N\/[K\(N — K)\], 
therefore, the exact binomial distribution yields 

Prob(Y N = f - 1) = A , (jv %, ««(l " a f~ K ■ (B.3) 

Using Stirling's approximation and writing K = pN and A^ — K — (1 — p)N 
one obtains 

P N (Y = 2p - 1) ~ e~ NI{a ' p) , (B.4) 

where 

p 1 — p 

I(a,p)—p\n h (1 — p) hi . (B.5) 

a 1 — a 

Note that I(a,p) is called "relative entropy" (or Kullback-Leibler divergence), 
and I(a,p) = for a = p, while I(a,p) > for a ^ p. It is easy to re- 
peat the argument for the multinomial case, where x 1 , ...,xn are independent 
variables that take m possible different values 01,02, ...,o m with probabilities 
7Ti, 7T2, vr m . In the limit N 1, the probability of observing the frequencies 
fi, /2, fm is 

Probxdfj} ~ {pj}) ~ e -^(M.W) 
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where 

Pj 



3=1 n 3 

is called "relative entropy" of the probability {p}, with respect to the proba- 
bility {n}. Such a quantity measures the discrepancy between {p} and {71"} in 
the sense that I({p}, {vr}) = if and only if {p} = {tt}, and I({p}, {tt}) > 
if {P} / W- 

From the above computation one undestands that it is possible to go beyond 
the central limit theory, and to estimate the statistical features of extreme 
(or tail) events, as the number of observations grows without bounds. Writing 
I(p, a) in terms of Y — 2p — 1, Eq. (B.4) becomes 

P N (Y) ~ e~ NS <n , (B.6) 

with 

l+Y 1+Y l-Y 1-Y 



2 2a 2 2(1 -a) ' 

The function S(Y) is called Cramer's function. Of course, for p close to a, i.e. 
Y ~ (Y), a Taylor expansion reproduces the central limit theorem (B.2). 

However Eq. (B.6) has a general validity, and can be derived in different ways, 
which show how the shape of S(Y) is related to the behaviour of the moments 
of the variable x. In particular it is possible to see that S(Y) can be expressed 
in terms of a Legendre transform: 



S(Y) = sup 



g 



qY - L{q) 



(B.7) 



where L(q) is the "Cumulants Generating Function" given by 

L(q) = ln(e gx ) . (B.8) 

Let us sketch the argument. Consider the quantities (e qNYN ) which can be 
written in two ways: 

( e qNY„) = ( e qx)N = e NL( q ) ^ 

(ei NY ») = j e« NY " P N {Y N )dY N ~ J e^ Y ~ s ^ N dY (B.10) 
whose identification leads to 

J e kYS(Y)]N dY ^ e NL( q) (Bn) 

and, in the limit of large N, using the steepest descent method, one has 



L(q) = sup 

Y 



qY - S(Y) 



(B.12) 
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which is the inverse of ((B.7)). Since it is possible to show that S(Y) is convex, 
Equations (B.7) and (B.12) are fully equivalent. 



For the more general and interesting case of dependent variables, L(q) is de- 
fined as 

L(q)= lim lln(e^i*->, 

N^oo iv 

and (B.7) is exact if S(Y) is convex, otherwise Eq. (B.7) gives the convex 
envelop of the correct S(Y). 

Let us note that the Cramer function must obey some constraints: 

a) S(Y) > for Y ^ (Y); 

b) S(Y) = for Y = (Y); 

c) S(Y) ~ (Y - (Y)) 2 /(2a 2 ), where a 2 = ((x - (x)) 2 ), if Y is close to (Y). 
Of course a) and b) are consequences of the law of large numbers, and c) is 
nothing but the central limit theorem. A mathematical introduction to the 
Large Deviation theory is given in [?]. 



C Appendix: Anosov systems 



Anosov systems play an important pedagogical role, in the theory of dynamical 
systems: their behaviour is highly chaotic and rich in structure. The celebrated 
Arnold cat map, defined by 





mod 1 



(C.l) 



on the unit square M. = [0, 1] x [0, 1], belong to this class. 
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Although they can be understood in rather simple terms, they are quite effec- 
tive in expressing the concept of deterministic chaos. Anosov dynamics S* can 
be discrete (Anosov diffeomorphisms) or continuous (Anosov flows), and are 
defined on smooth manifolds Ai (the phase space). Anosov diffeomorphisms 
and flows are not completely equivalent, although from a flow one may always 
extract a map, observing the continuous time dynamics at discrete instants of 
time. Here, we limit our attention to properties which are similar in the two 
cases, presenting the general theory for continuous time systems, since physi- 
cal systems mostly have continuous time, and illustrating it on the Arnold cat 
map, which can be explicitly worked out in detail. 

For simplicity, assume that the dynamics explores densely A4, i.e. that it is 
transitive. Then, the main feature of an Anosov system is that M. is hyperbolic, 



2(1 



Because of the mod operation, the Arnold cat map is not a linear map. 
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i.e. that for all X G A4, the tangent space T X M continuously splits in a stable, 
an unstable and a neutral linear space [?], E X ,E X and E\ respectively. The 
tangent space of a flow at a point X G Ai can be interpreted as the space of 
all possible velocities at that point. Indeed, the evolution remains in M., hence 
these velocities can only be tangent to M. in that point, and constitute a linear 
space of dimension equal to the dimension of M.. The points in T X M are then 
also called tangent vectors. More precisely, let DS t (X) be the Jacobian map of 
the transformation S f (which evolves any initial condition X into X t = S t X) 
evaluated at the point X. Clearly, DS t (X) depends on both t and X. Then, 
for a flow, transitivity and hyperbolicity mean that: 

a) TxM. = Ex © E s x © E x is continuous (or smooth) in X, i.e. in any coor- 
dinate chart, the components of a constant vector field are continuous (or 
smooth) functions of the coordinates of the point X. E x is a one-dimensional 
linear subspace in case of flows, while it reduces to {0} in case S l is a map. 

b) The linear subspaces E s x and E\ are invariant with respect to the tangent 
(or Jacobian) map DS l , i.e. for all X G M. DS\X)E S X = E s st ^ x) and 

DS\X)E X = E%t( X y 

c) There exist C > and 1 > 9 > 0, such that for all t G IR, we have 
II DS*(X)Z || < C9 t \\ i ||, for all £ G E s x and || DS-\X)r] ||< C0*|| rj ||, for 
all V?7 G E\. 

The tangent space at X may also be seen as the space which contains the 
infinitesimal perturbations 5X = X' — X of the initial point of a given trajec- 
tory, that produce nearby trajectories. Because X and X' lie in M, because 
M. is assumed to be smooth, hence to have a tangent in X, and becuase 5X 
is infinitesimal, 5X lies in this tangent space, of dimension equal to that of 
M.. The tangent vectors evolve according to the rule DS t (X)SX , hence con- 
diton c) implies that they all grow or decrease at exponential rates, which are 
everywhere bounded away from zero, except for the tangent vectors directed 
along the neutral space. 

Furthermore, transitive Anosov systems enjoy the following properties [?,?]: 

(1) the stable and unstable manifolds 

W x — {X' G M. : lim \\S l X' - S l X\\ = 0} 

W x = {X' G M : hm \\S~ l X' - S~ l X\\ = 0} 

are globally defined and dense in M, for every X G M. (transitivity); 

(2) periodic orbits are dense in M; 

(3) there is an invariant measure [i which represents the statistics of the for- 
ward time evolution, and which has a density along the unstable direc- 
tions. Such a measure is usually called Sinai- Ruelle-Bowen (SRB) measure 
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and satisfies 

lim I / T $(^X)= h{yW{y) = {<$>) 

for (Lebesgue) almost all X G 7W. For maps, the same holds, if the time 
integral is replaced by a sum over time steps. 

Thanks to property (2), \x can be represented in terms of orbital measures. 
If P (T, T + e] is the set of the unstable periodic orbits of the system, with 
period r£ (T, T + e], for a fixed e > and for any T > 0, the following holds 



Theorem:Le£ (M,S l ) be an Anosov flow (with S* G C 2 ). Let $ G C 1 , and 
let j be an unstable periodic orbit of period Tj. For any Xj G j , denote by J" 
the Jacobian of the dynamics restricted to the unstable manifold, with initial 
condition Xj. Then, for all e > 0, 

($) = lim J€P(T ' T+e ' 1 ^ / T ° . ^— (C.2) 

where Xj is any point in the orbit j. 

A version of Eq.(C.2) is available for maps, and is formally identical to (C.2): 
it suffices to replace the integrals by sums. It is interesting to note that ($) is 
obtained as a weighted average of orbital averages, with weights 

(j;)- 1 • Tj (c.3) 

which have the suggestive form "inverse of instability x period": i.e. one orbit 
contributes more than another to (<£>) if it has larger period, but contributes 
less if it is more unstable. Furthemore, it has been observed that the neigh- 
bourhoods of the periodic orbits of a given interval of periods afford, at least 
in some systems, a hierarchical tessellation of the phase space, which is finer 
where \x is higher [?]. This should yield a rather quick convergence of the 
limit in (C.2), because the low period orbits cover the parts of phase space 
which have higher probability, leaving to the long period ones the task to cover 
even the less probable parts. However, Eq.(C.2) has proved highly non-trivial 
to use for practical computations, and it has been tested and used only in 
low-dimensional systems, such as the Lorentz gas [?,?]. This does not prevent 
the use of that formula for theoretical calculations, hence various results of 
statistical mechanics interst have been obtained through it (see, e.g. [?,?,?]). 
Furthermore, it was the use of such weights that led the authors of [?] to 



27 This theorem holds more generally for Axiom- A systems, which may have a finite 
number of attracting sets. 
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propose the Q-FR (which happened to coincide with the A-FR in their case). 
This is why the mathematical formulation of the A-FR given by Gallavotti 
and Cohen was based on the Chaotic Hypothesis, i.e. on the hypothesis that 
systems of physical interest behave as if they were transitive Anosov systems. 

All the above is easily illustrated by means of the Arnold cat map. Being a 
diffeomorphism, it has no neutral direction, and its tangent space at any point 
X G M. is TxM- = IR 2 - The eigenvalues and the eigenvectors of the matrix 
defining the map are X UyS = (3 ± v^) /2, and 




where is the golden ratio. Therefore, points that lie close to (0,0), in the 
straight line of slope passing through the point (0, 0) remain in that line and 
their distance grows by a factor at each iteration. When these points cross the 
boundary of the unit square, they re-enter the square from the opposite side, 
and continue to move on a line of same slope, while their distance continues to 
grow by the same factor, except for the effect produced by the mod operation. 
Therefore, the infinite line of slope 0, passing through (0,0), cut and moved 
by the mod 1 operation, constitutes the unstable manifold of the point (0, 0). 
Similarly, the line of slope — _1 , passing through (0,0), cut and moved by 
the mod 1 operation, constitutes the stable manifold of (0,0), because its 
points are moved along that direction, while their distances are reduced by 
the factor _1 at every iteration of the map. Similarly, one finds that each 
point X G M. has stable and unstable manifolds which are the straight lines 
of slopes and — _1 , passing through X, mod 1. The exponential growth 
and decrease of the sizes of the tangent vectors are precisely the factors and 
_1 , because the tangent vectors are linear combinations of v u and v s . The 
density of the unstable manifold of the point (0, 0), in the Arnold cat map, is 
easily understood observing that its slope is irrational. Therefore, if one thinks 
of it as the trajectory of a point particle, which moves at constant velocity, 
exits the square at given instants of times, and re-enters the square form the 
opposide side, one realizes that it can never re-enter at a point which has been 
previously visited. In other words, this trajectory, i.e. the unstable manifold, 
wraps around densely exploring all of M.. The invariant SRB measure is the 
Lebesgue measure dfi = dxdy, and the density of the periodic orbits follows 
from the fact that the pieces of stable and unstable manifolds of a point 
intersect forming a grid (called Markov partition), whose cells have invariant 
borders, inside each of which there are periodic points. Becuase the manifolds 
are dense, hence can form arbitrarily fine grids, the density of the periodic 
points follows. To find the periodic points of period n, one must solve the 
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equation 



x 



\ 



X 



mod 1 



(C.5) 



For instance, (0, 0) is a fixed point, hence it is periodic of all periods. All the 
periodic orbits are unstable, because of the ubiquitous hyperbolic structure. 

Normally, the Anosov systems that are considered to illustrate the idea of 
chaos in physics are low dimensional, like the Arnold cat, because their dimen- 
sionality is not particularly important for their statistical properties. These 
properties are due to the uniform hyperbolicity, i.e. to the violent and ubiq- 
uitous trend of the trajectories to separate at an exponential rate, which pro- 
duces an extremely high degree of mixing in the phase space. This makes 
possible to formally obtain in low dimensional Anosov dynamics certain prop- 
erties that are expected to hold in thermodynamic systems, like the symmetry 
of Onsager relations [?]. Obviously, the physical content of that symmetry in 
a system of one particle is totally different from the content of that symmetry 
in a thermodynamic system, and is obtained for completely different reasons. 
Adding that hardly any system of physical interest is of the Anosov kind, that 
the phase space dynamics is not the real space dynamics, and recalling the 
meaning of the statistical laws, as expressed e.g. in [?], cf. Sect. 4. 4.1, leads to 
the conclusion that some care must be used in describing physical phenomena 
by means of Anosov systems. 



D Appendix: A pedagogical example 



It is very instructive, also from a pedagogical point of view, to work out, for a 
system simple enough, the connection between some of the results discussed 
in Sections 5, 6 and 7. We closely follow a recent interesting paper by Astu- 
mian [?], which considers the overdamped dynamics of a colloidal particle im- 
mersed in a fluid with viscosity 7, subject to a conservative force F c = —U'(x) 
and pulled by a non-conservative force F nc (t) = g(t)F ext . The position x of 
the particle obeys the Langevin equation 

^ = F(t) + yfifivV), (D.l) 

where F(t) = F c + F nc (t), r](t) is a Gaussian white noise. This is also the 
equation that governs the process of pulling a terminal of a macromolecule 
anchored to a surface and surrounded by water; this system has been studied 
in recent experiments [?,?]. 

Following the discussion of Onsager-Machlup theory in Sec. 7.1,, in particular 
the non-linear generalization of Par. 7.1.1, one can obtain the probability 
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density of a path starting at time to and ending at time t. Again it is sufficient 
to consider discrete times to + kr with r arbitrarily small and k G [0,n] 
with n being the integer part of (t — to)/r. Since the noise is Gaussian and 
delta-correlated, the sequence of variables i] k = r)(t + kr) has the probability 
density 



P[(Vn,t\...\r] ,0)] oc exp ^--^^ 



which, in the limit r — > 0, becomes 

P[(Vn,t\--\Vo,0)] oc exp 



1 /■* 
2 



(D.2) 



(D.3) 



Equation (D.l) tells us that rj(t) = (f - F/i)/y/2D, with D = T/ 7 , which 
finally gives us 

P[{77(*)}] oc exp(-L), (D.4) 

where 



AD Jo S \ds 7 J 



AU-w ext [{r)(t)}} 1 /•* 

2 7 D AD Jo S 




is the thermodynamic action, 



(D.6) 



is the work done by the external forcing F nc (t) and AU = — J** F c (x)dx is 
the difference of potential between the final and the initial position. To find 
the most probable path from (xq,0) to (x t ,t), it is sufficient to minimize the 
action (D.5) while keeping fixed the endpoints. Note that to obtain, from 
Eq. (D.4), the correct probability density for the trajectories x(t), one has 
to calculate the Jacobian of the transformation r)(t) — > x(t). Anyway, even 
disregarding this problem, many interesting results discussed in this review 
can already be reproduced. 

• A difference (asymmetry) between the probability of a path {r)(t)} and its 
time-reversed {Ir)(t)}, follows from the fact that the last integral in (D.5) 
does not change sign upon applying the time-reversal operator /. This cor- 
responds, in this example, to the asymmetry of paths discussed in 7.2.1. Of 
course the richness of the recent results in Sections 7.2 and 7.3 (such as the 
non- locality of the entropy functional), which concerns spatially extended 
systems (fields) cannot be reproduced by this example. 

• The ratio between the probability density of a path and that of its time- 
reversed reads: 

P[v(t)} f w ex Mt)} - au \ 

pint)} exp l w J' 



(D.7) 
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which, for large times, allows one to identify the work w ext done by the 
external non- conservative force (divided by ksT) as the entropy produced 
during the time t. This is an example of the result by Kurchan [?] and by 
Lebowitz and Spohn [?] on the FR for stochastic systems. Even without 
referring to the FR, Eq. (D.7) is interesting because the r.h.s. does not 
depend explicitly on time. 
• By a simple calculation it is immediate to see that 

P(w ex Mt)] = W) [W\ try , 

= ex P (D-8) 



P{w ext [ V {t)] = -W) * \k h T 



which is the FR for stochastic systems. 
Finally, one has 



exp fe)) = £>«* ) p{w) = I.j wp (-w) = i 

(D.9) 

which is nothing but the Jarzynski relation, or the partition identity, in this 
steady state case. 



148 



